REMARKS / ARGUMENTS 



In view of the foregoing amendments and the 
following remarks, the applicant respectfully submits 
that the pending claims are not anticipated under 35 
U.S.C. § 102. Accordingly, it is believed that this 
application is in condition for allowance. If, however, 
the Examiner believes that there are any unresolved 
issues, or believes that some or all of the claims are 
not in condition for allowance, the applicant 
respectfully requests that the Examiner contact the 
undersigned to schedule a telephone Examiner Interview 
before any further actions on the merits. 

The applicant will now address each of the 
issues raised in the outstanding Office Action. 

Election/Restrictions 

The Examiner withdrew claims 1 and 3-6 from 
consideration as being directed to a non-elected 
invention. (See Paper No. 10, page 2.) These claims 
have been cancelled. 

Request under 37 CF.R. § 1,48 (b) 

The applicants request that inventor Osamu Nonaka be 
deleted. The inventor's invention is no longer being 
claimed in the application. More specifically, the 
correct inventors were named in the application, but the 
prosecution of this application has resulted in the 
amendment or cancellation of claims so that fewer that 
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all of the currently named inventors are the actual 
inventors of the invention being claimed in this 
application. The undersigned is a party set forth in 37 
C.F.R. § 1.33(b), The processing fee of $ 130.00, set 
forth in 37 C.F.R. § 1.17(i), is filed herewith. 

Objections 

The specification stands objected to as including an 
improper incorporation by reference of foreign 
applications. The specification has been amended to 
remove this incorporation by reference. Therefore, this 
objection is now moot and should be withdrawn. 

Claim 14 is objected to as being dependent upon a 
rejected base claim but would be allowed if rewritten in 
independent form. Since claim 13, from which claim 14 
depends, is now in condition for allowance, the applicant 
has not rewritten claim 14 as this time. 

Rejections under 35 U.S,C. § 102 

Claims 7, 8, 12 and 13 have been rejected under 35 
U.S.C. §102 (e) as being anticipated by U.S. Patent No. 
6,434,332 ("the Kindaichi patent"). The applicant 
respectfully requests that the Examiner reconsider and 
withdraw this ground of rejection in view of the 
following. 

The Kindaichi is not valid prior art to the 
above-captioned application under 35 U.S.C. § 102(e) 
because the effective filing date of the above-captioned 
application (November 16 and/or 30, 1999), now perfected 
by the filing of certified accurate translations of the 
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priority applications, predates the U.S. filing date of 
the Kindaichi patent (May 3, 2000). Priority was claimed 
in lines 4-8 of page 1 of the specification and in the 
executed Declaration and Power of Attorney form filed on 
November 15, 2000. Certified copies of the priority 
documents were also filed on November 15, 2000, the 
receipt of which was acknowledged in item (13) of the 
Office Action Siimmary. The Examiner noted that the 
applicants cannot rely upon the foreign priority papers 
to overcome this rejection because a translation of these 
papers was not made of record. (See Paper No. 10, page 
2.) Since, however, certified translations of these 
papers are filed herewith, priority to the foreign patent 
applications is now perfected in accordance with 37 
C.F.R. § 1.55(a)(4) and MPEP § 201.15. In view of the 
foregoing, the claims are allowable over the Kindaichi 
patent . 

Conclusion 

In view of the foregoing amendments and remarks, the 
applicant respectfully submits that the pending claims 
are in condition for allowance. Accordingly, the 
applicant requests that the Examiner pass this 
application to issue. 



October 10, 2003 




John/ C, Pokotylo, Attorney 
Reg. No. 36,242 
Tel.: (732) 542-9070 
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CERTIFICATE OF MAILING under 37 C.F,R. 1.8(a) 



I hereby certify that this correspondence is being 
deposited on October 10, 2003 with the United States 
Postal Service as first class mail, with sufficient 
postage, in an envelope addressed to Mail Stop AF, 
Commissioner for Patents, P.O. Box 1450, Alexandria, VA 
22313-1450. 





36,242, 



John C. Pokotylo 



Reg . No . 



-11- 



TRANSLATION 



I, Masashi Hoshino , residing at 4-14-2 , Simo, Kita-ku, Tokyo, Japan, 
Japan state : 

that I know well both the Japanese and English languages; 
that I translated, from Japanese into English, Japanese Patent 
i^lication No. 11-340753, filed on November 30, 1999; and 
that the attached English translation is a true and accurate 
translation to the best of my knowledge and belief. 



Dated: October 6, 2003 




Masashi Hoshino 



PATENT OFFICE 
JAPANESE GOVERNMENT 



This is to certify that the annexed is a true copy of the following 
application as filed with this Office. 
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Commissioner, 
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[Document] SPECIFICATION 

[Title of the Invention] DISTANCE MEASURING DEVICE 
[Wliat is claimed is:] 

[Claim 1] A distance-measuring device capable of 
executing distance measurement at a plurality of points in 
a photography screen, comprising: 

a sensor array having pixel rows, a detection pixel 
pitch of the sensor array being able to be switched 
between at least fine and rough pitches; 

specifying means for setting the detection pixel 
pitch of the sensor array at the rough pitch to determine 
an outline of an image existing in a detection field of 
the sensor array so as to specify an object, a distance to 
which should be measured; and 

means for setting the detection pixel pitch of the 
sensor array at the fine pitch to determine the distance 
to the object specified by the specifying means. 

[Claim 2] The distance-measuring device according to 
claim 26, wherein the detection pixel pitch of the sensor 
array is set by summing signals output from adjacent 
pixels or by pixel skipping. 

[Claim 3] A distance-measuring device capable of 
executing distance measurement at a plurality of points in 
a photography screen, comprising: 

a sensor array having pixel rows, the sensor array 
being able to be switched between a linear mode in which 
an output value thereof is proportional to an amount of 
incident light, and a compression output mode in which the 
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output value is a logarithmic compression value of the 
amount of incident light; 

specifying means for setting the sensor array in the 
compression output mode to determine an outline of an 
image existing at the plurality of detection points in the 
photography screen so as to specify an object, a distance 
to which should be measured; and 

means for setting the sensor array in the linear mode 
to determine the distance to the object specified by the 
specifying means. 

[Claim 4] A distance-measuring device comprising a 
sensor array and capable of executing distance measurement 
at a plurality of points in a photography screen, 
compris ing : 

first and second A/D conversion modes that can be 
switched over therebetween, configured to detect a value 
of an output from each of pixels of the sensor array; 
a first operation mode configured to identify a 
characteristic point of an image at each point within the 
photography scene; and 

a second operation mode configured to identify a 
distance to the image at each point within the photography 
scene ; 

wherein the first and second A/D conversion modes are 
switched over between them in response to the first and 
second operation modes in a distance measuring sequence. 
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[Detailed Description of the Invention] 
[Field of the Invention] 

This invention relates to a distance-measuring device 
installed in a camera, and more particularly to a 
distance-measuring device for measuring, at high speed, a 
subject in a to-be-photographed scene. 
[Prior Art] 

In generals, cameras are equipped with distance- 
measuring devices that measure the distance to an object 
to be photographed and adjust the picture-taking lens to 
focus on the object- 
In different to-be-photographed scenes, different 
subjects must be photographed and hence the camera must be 
focused on different portions of the subjects. For example, if 
the main subject is a person, the camera is focused on an upper 
portion, such as the face, of the person. If, on the other 
hand, the main subject is scenery or a building, the camera is 
focused on its center. 

Usually, however, a distance-measuring point for a 
shortest distance to an area in which the main subject seems to 
exist is selected, thereby executing focusing. 

In light of this, there is a technique for detecting a 
distinctive portion of a main subject in a to-be-photographed 
scene, and executing appropriate focusing for the main subject. 

Japanese Patent Application KOPCAI Publication 
No. 11-25263, for example, discloses a technique for detecting 
a distinctive point of a subject (area) existing in a to-be- 
photographed scene, on the basis of the outline of the subject. 
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the distance distribution of the subject, or the actual size of 
the subject calculated from the distance distribution and the 
outline of the subject. On the basis of the detection result, 
exposure time during photography, for example, is controlled. 
[Object of the Invention] 

In the technique for detecting a distinctive point of a 
subject, disclosed in Japanese Patent Application KOKAI 
Publication No. 11-252 63, determination of a distance-measuring 
point is especially important. 

More specifically, a sensor section for executing 
distance measurement often has a structure in which pixels 
consisting of, for example, photoelectric conversion elements 
are arranged in a matrix or in a plurality of rows. If this 
so-called sensor array is also used as an image sensor for 
detecting a distinctive point of a subject, another sensor and 
its space dedicated to the detection of the distinctive point 
are not necessary. 

Pattern detection for detecting such a distinctive point 
does not require such accurate detection of a distribution of 
reflected light as executed for distance measurement. More 
easy detection provides a sufficient result. Therefore, if the 
pattern detection is executed at the same speed as distance 
measurement, it is a waste of time. 

As a solution to the above-described problem, the object 
of the present invention is to provide a high-speed and highly 
accurate distance-measuring device by way of a process 
different from the distance measurement and the pattern 
detection used to detect a characteristic point of an object. 
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which is designed to eliminate the waste in the load of 
operation and in time as much as possible in balance, 
[iyieans for Achieving the Object] 

In order to achieve the above-described object, there is 
provided, according to an aspect of the present invention, a 
distance-measuring device capable of executing distance 
measurement at a plurality of points in a photography screen, 
comprising: a sensor array having pixel rows, a detection pixel 
pitch of the sensor array being able to be switched between at 
least fine and rough pitches; specifying means for setting the 
detection pixel pitch of the sensor array at the rough pitch to 
determine an outline of an image existing in a detection field 
of the sensor array so as to specify an object, a distance to 
which should be measured; and means for setting the detection 
pixel pitch of the sensor array at the fine pitch to determine 
the distance to the object specified by the specifying means. 

According to another aspect of the present invention, 
there is provided a distance-measuring device capable of 
executing distance measurement at a plurality of points in a 
photography screen, comprising: a sensor array having pixel 
rows, the sensor array being able to be switched between a 
linear mode in which an output value thereof is proportional to 
an amount of incident light, and a compression output mode in 
which the output value is a logarithmic compression value of 
the amount of incident light; specifying means for setting the 
sensor array in the compression output mode to determine an 
outline of an image existing at the plurality of detection 
points in the photography screen so as to specify an object, a 
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distance to which should be measured; and means for setting the 
sensor array in the linear mode to determine the distance to 
the object specified by the specifying means. 

According to still another aspect of the present 
invention, there is provided a distance-measuring device 
comprising a sensor array and capable of executing distance 
measurement at a plurality of points in a photography 
screen, comprising: first and second A/D conversion modes 
that can be switched over therebetween, configured to 
detect a value of an output from each of pixels of the 
sensor array; a first operation mode configured to 
identify a characteristic point of an image at each point 
within the photography scene; and a second operation mode 
configured to identify a distance to the image at each 
point within the photography scene; wherein the first and 
second A/D conversion modes are switched over between them 
in response to the first and second operation modes in a 
distance measuring sequence. 

The distance-measuring device, with the above-described 
structure, comprises a sensor array which determines, when 
an object used for distance measurement is to be determined, 
a distance-measuring point (main object to he photographed 
in a scene) while setting the pitch of the pixels of the 
sensor array to the rough mode, and when the distance to the 
main object is to be determined, measures the distance while 
the detection pixel pitch is set to fine mode. Or the 
switching of the pixel pitch is carried out by reading out 
the pixels in a thinning out manner, or reading out them 



7 



while adding adjacent pixel signals. 

The distance-measuring device, with the above-described 
structure, comprises a sensor array which determines, when 
an object used for distance measurement is to be determined, 
a distance-measuring point (main object to he photographed 
in a scene) while setting to a compression output mode and 
detecting the outline of the object from the logarithmic 
compression value of the amount of incident light, and when 
the distance to the main object is to be determined, 
measures the distance to the object from the output value in 
proportional to the amount of incident light while set to 

the linear mode. 

Further, the distance-measuring device measures the 
distance to a main object to be photographed by the first and 
second A/D conversion modes, which can be switched over. In 
shooting, the first operation mode is set to identify a 
characteristic point of an image at each point within a scene 
and determines a main object to be photographed, and then the 
A/D conversion mode is switched, the distance to the main 
object is measured by the second operation mode. 
[Embodiments of the Invention] 

Embodiments of the present invention will now be 
described in detail with reference to accompanying drawings. 

Before we explain the embodiments, we will first explain 
the distance-measuring device operating on the principle of 
triangulation with reference to FIGS. 1 and 2. 

In the following embodiments, which will be described now 
and later, the sensor section of the distance-measuring device 
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is formed of a line sensor consisting of pixels (sensors) as 
photoelectric elements that are arranged in line, or an area 
sensor consisting of_pixels (sensors) that are arranged two- 
dimensional, for example, in a matrix. Further, any one of the 
line sensor and the area sensor is referred to as a sensor 
array. 

In these figures, when sensor arrays 2a and 2b have 
detected an image of a subject 4 at high accuracy via two light 
receiving lenses 3a and 3b separated from each other by a base 
length B, the parallax between the lenses causes a positional 
difference x of the image as a result of a similar effect to 
the eyes of a person. A distance L to the subject is obtained 
by the equation L = B • f /x. 

Since the image position is determined by comparing two 
images output from the two sensor arrays 2a and 2b, it is 
necessary to detect images using very high resolution. Further 
f represents the focal distance of each light receiving lens. 

A computing control section (CPU) 1 calculates the 
relative positional difference x of the subject images on the 
basis of the outputs of the two line sensors, thereby 
calculating the distance L to the subject using the 
aforementioned equation, and controlling a focusing section 5 
so as to focus the camera on the subject. This processing 
realizes a so-called auto-focusing (AF) camera. 

Furthermore, when the subject 4 is not situated on a 
central portion of a screen 6 corresponding to a photography 
lens 7, but deviated by an angle 6 in the x-direction as shown 
in FIG. 3(a), it is sufficient if the position of that one of 
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the sensor arrays 2a, which is used as a reference sensor, is 
shifted by xq. 

From the relationship 9 = arctan (XQ/f ) r a distance to 
the subject displaced by 0 can be measured. Thus, the 
distance measurement enabled position can be widened in the x- 
direction by shifting the line sensor. After that, it is 
sufficient if it is determined by pattern detection at which 
position of the sensor distance measurement should be chiefly 
executed. 

A description will be given of a case where line sensors 
are used for pattern detection for detecting a characterizing 
point of an object in a first embodiment. 

When the CPU 1 has excited a xenon tube 9 incorporated in 
a strobe unit 8 as shown in FIG.l, a light signal reflected 
from the subject or person 4 enters the sensor array 2a via the 
light receiving lens 3a. 

From a distribution of light output from the sensor array 
2a, the distance to the main subject 4 can be detected. 

More specifically, as shown in FIG. 3(a), reflected light 
is distributed on the sensor array 2a, and the position xi of 
the reflected light is detected, thereby detecting the position 
of the person as an angle 9 with respect to the center of the 
screen . 

For example, supposing that the pitch of each pixel of 
the sensor array is P, the Pg-th pixel corresponds to the 
center of the screen, and the center of the reflected light 
exists on the Pi-th pixel, it is considered that the subject is 
situated in a position (-xi) (x - (Pi - Po)/P), i.e., in terms 
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of 0 , in a position 0 = arctan (-x/f ) . Accordingly, it is 
sufficient if distance measurement is chiefly executed in this 
position . 

However, to obtain only (-xi) , not so accurate detection 
of a distribution of the reflected light (image detection) as 
executed for the above-described distance measurement is 
necessary. 

Therefore, it is sufficient if it is determined whether 
or not the amount of light is more than a voltage Vqi as shown 
in FIG. 3(c), and binarized light amount determination as shown 
in FIG. 3(d) is executed. In a method for sequentially 
comparing the sensor output with various voltages obtained by 
dividing a reference voltage as shown in FIG. 2(b), thereby 
executing A/D conversion, the to-be-compared voltage Vcomp can 
be fixed at Vqi, and hence the position of the main subject can 
be determined at high speed. 

FIG. 2(c) is a flowchart useful in explaining focusing 

processing . 

First, before distance measurement, a rough pitch line 
sensor output is obtained and subjected to A/D conversion, 
thereby determining a pattern (step SI) . Subsequently, a 
distance-measuring point is determined (step S2) , and then a 
fine pitch line sensor output is obtained and subjected to A/D 
conversion, thereby calculating a distance (step S3) . Since 
A/D conversion is thus executed on image of different 
resolutions, focusing processing can be executed at high speed. 

A description will be given of a second embodiment where 
area sensors are used for pattern detection for detecting a 
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characterizing point of an object. 

In the above-described first embodiment, high speed 
focusing cannot be executed on, for example, a scene in which 
an object (person) 4 as a main subject is not situated in a 
central position as shown in FIG. 3(b). To overcome this, the 
ninth embodiment employs area sensors instead of the line 
sensors for executing high speed processing on such a scene. 

As shown in FIG. 4(b), the distance-measuring area of 2a 
of a line sensor is a central slim area in the photography 
screen 12 of the camera. On the other hand, an area sensor is 
identical to a structure in which line sensors are arranged 
two-dimensional, and accordingly the distance-measuring area 
can be widened to an area 13 substantially the same as the 
photography screen 12. 

When pick upping a scene as shown in FIG. 4(a) in the 
prior art, two-step exposure, a so-called focus lock operation, 
is executed. Specifically, at first, a main subject is 
contained in a distance-measuring area (a central portion of 
the screen) , and a release button is half-pushed to execute 
distance measurement- After that, the camera is shifted to a 
position in which a to-be-photographed scene can be contained 
in the screen, with the release button half-pushed, thereby 
further pushing the release button to execute exposure. 

This operation, however, requires time and effort for a 
pre-operation before pick upping, and may loose good timing for 
photography in the case of pick upping a moving subject. If an 
area sensor is used to widen a distance-measurement-enabled 
area, a distance to a main subject situated even in an end 
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portion of the photography screen as shown in FIG. 4(a) can be 
measured. 

However, even if the technique for measuring a distance 
to an object situated in an end portion of the photography 
screen is used, a technique for detecting where in the 
photography screen the main subject exists becomes important 
since the number of distance-measurement-enabled points 
increases . 

Where the number of distance-measuring points is 
extremely increased, sequential execution of distance 
measurement for the distance-measuring points requires a lot of 
time greater than in the case of the focus lock operation. 
This is very disadvantageous especially because the area sensor 
is more expensive than the line sensor. 

Referring then to FIG. 5, a description will be given of 
the concept of the distance-measuring device, according to the 
second embodiment, for detecting the position of a main subject 
at high speed. 

First, as shown in FIG. 5(a), emission is executed at a 
wide angle corresponding to the photography screen before 
distance measurement. FIG. 5(b) shows a pattern equivalent to 
that distribution, on an area sensor, of light reflected from a 
to-be-photographed scene, which is based on differences of 
distance to the scene. 

Almost no ref lected-light signal is returned from a 
complicated background since it is located at a long distance 
from the camera. On the other hand, ref lected-light signals 
are returned from a person and flowers located at a short 
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distance from the camera. Accordingly, the pattern formed on 
the area sensor is very simple as shown in FIG. 5(b). 

It can be determined in which position on the photography 
screen the main subject exists, by causing the computing 
control section of the camera to compute the binarized pattern 
signal on the basis of a predetermined sequence of pattern 
determination processing. 

This way of thinking is similar to that described with 
reference to FIGS. 1-3. If distance measurement is executed 
at a distance-measuring point based on the determined position 
as shown in FIG. 5(c), an auto-focusing (AF) technique for 
instantly focusing the camera on a main subject is realized, 
irrespective of on which portion of the photography screen the 
main subject exists. 

At this time, the distance measurement method may be 
switched, depending upon the situation, between the so-called 
active type method for emitting light dedicated to distance 
measurement, and the passive type method for executing distance 
measurement without light dedicated to distance measurement. 

FIG. 6(a) is a view useful in explaining the concept of 
the second embodiment. More specifically, FIG. 6(a) shows an 
example of a structure for executing distance measurement by 
detecting the position of a subject 21 using pre-emission. 

In this case, at first, auxiliary light is projected from 
a strobe unit 24 onto the subject 21 under the control of a 
light projection control circuit 23. Light reflected from the 
subject enters two light receiving lenses 25a and 25b and then 
two area sensors 2 6a and 2 6b. 
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The area sensors 26a and 26b receive light indicating a 
subject and subject it to photoelectric conversion. The 
outputs of these sensors are subjected to A/D conversion in an 
A/D converter circuit 27, and the digital value of each pixel 
is input to a computing control section (CPU) 28. 

The area sensors 26a and 26b are connected to a fixed- 
light eliminating circuit 30, where an DC light signal that 
constantly enters the sensors through the photography screen is 
eliminated under the control of the computing control section 
28, thereby outputting only a signal indicating pulse light 
(auxiliary light) from the strobe unit 24. 

Accordingly, when the area sensors 26a and 26b receive a 
ref lected-light signal while the fixed-light eliminating 
circuit 30 is operated, they form, on their respective light 
receiving surfaces, an image coated in black as shown in FIG. 
6(b). The pattern of the image formed on the sensor sensors is 
analyzed by a pattern determining section (e.g. formed of 
software) incorporated in the computing control section 28. If 
the image pattern is determined to indicate a person, the 
pattern can be considered to be a main subject. 

Referring to the flowchart of FIG. 7, distance 
measurement executed by the distance-measuring device of the 
second embodiment will be described. 

First, before executing distance measurement, the 
projection control circuit 23 incorporated in a projection 
section 22 controls the strobe unit 24 so as to execute pre- 
emission, thereby projecting auxiliary light onto the subject 
21 and causing light reflected from the subject to enter the 
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area sensors 26a and 26b, At this time, the fixed-light 
eliminating circuit 30 is operated to eliminate fixed light 
from the ref lected-light signal entering the area sensors 26a 
and 26b, thereby extracting only an image signal from the 
reflected- light signal (step Sll) • 

Subsequently, the A/D converter circuit 27 subjects the 
extracted image signal to A/D conversion, and the A/D converted 
image signal is input to the computing control section 28, 
where the image pattern formed on the area sensors 2 6a and 2 6b 
is analyzed using predetermined software (step S12) . 

It is determined whether or not the analyzed image 
pattern indicates, for example, a person and can be considered 
to be a main subject (step S13) . A description will now be 
given of how the detected pattern is determined to indicate a 
person. 

As shown in FIG. 8(a), each area sensor 26a or 26b is 
formed of line sensors arranged in rows in the photography 
screen. For facilitating the explanation of pattern 
determination, only line sensors of three rows 31a, 31b and 31c 
are selected. In the case of a scene as shown in FIG. 8(b), 
any portion of the person does not exist in a position 
corresponding to the line sensor 31a, while the face and the 
body of the person are situated in positions corresponding to 
the line sensors 31b and 31c, respectively. Accordingly, 
output results as shown in FIG. 8(c) are obtained corresponding 
to the respective line sensors. 

In this embodiment, on the basis of a t£b-shaped 
distribution of ref lected-light intensity at each row, it is 
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determined whether or not the subject is a person. 

Referring to the flowchart of FIGS. 9 and 10, this 
pattern determination will be described. 

First, it is designated to execute pattern determination 
along the row 31a (step S31) . After finishing processing along 
the row 31a, the program proceeds to steps S54 and S56, 
described later, where similar processing is executed along the 

rows 31b and 31c. 

Subsequently, a change A Pq for \^ determination is set at 
a predetermined change APqi, and the fi-shaped distribution is 
detected depending upon whether or not the change APqi causes 
a great change (step S32) . Then, the CPU 28 shown in FIG. 1 
reads the output of a pixel with coordinates (1, y) of each 
area sensor 26a or 26b, i.e. a first pixel at the row 31a (step 
S33) . Since 300 pixels (photoelectric elements for distance 
measurement) are arranged in the x-direction of each sensor 26a 
or 26b, the value x is incremented sequentially (step S34) . 
Until the value x reaches 300, the processing at a step S36 et 
seq. is repeated (step S35) . Before the value x reaches 300, 
the sensor output is read by the CPU 28 each time the value x 
is incremented by 1 (step S36) , thereby calculating AP from 
the following equation ( step S37): 
AP = Pq (x) - Pq (x-1) 

Subsequently, the resultant AP is compared with the value 
APq of a pixel adjacent to the first-mentioned one (step S38). 
If AP ^ APq (if the answer is NO), the absolute value |AP| 
of AP is calculated (step S39) . Then, AP is compared with 
the value Pq of the adjacent pixel (step S40) . IfAP ^ Pq, 
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the program returns to the step S34 . At the step S38, the 
comparison is executed to determine a pixel at which the sensor 
output sequentially increases, while at the step 40, the 
comparison is executed to determine a pixel at which the sensor 
output decreases. In other words, if an increase greater than 
PO at the step S38 is found, and a decrease is found at the 
step S40, the af orementioneddi-shaped light distribution is 
detected. 

On the other hand, if Ap > APq (i.e. if the answer at the 
step 38 is YES), the program proceeds to steps S41 - S46, where 
it is determined in which row 31a, 31b or 31c shown in FIGS. 8 
the values x forming are included, thereby storing the 
determination results in a memory (not shown) incorporated in 
the CPU 28. 

Similarly, if AP > Pq at the step S40 (i.e. if the answer 
is YES), the program proceeds to steps S47 - S52, where it is 
determined in which row 31a, 31b or 31c the values x forming di 
are included, thereby storing the determination results in the 
memory of the CPU 28. For example, if the tfh-shape is detected 
at the row 31a, the x-coordinate of the leading edge of the i£h- 
shape is expressed as xisia, and that of the trailing edge is 

expressed as X23ia- 

The resetting of A Pq at steps S44 and S50 is executed to 
increase the determination level in order to prevent the 
processing at the step S38 or S40 to be executed again and 
again. 

After that, it is determined whether or not the value y 
indicates the row 31a (step S53) . If it indicates the row 31a 
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(i.e. if the answer is YES), the value is changed to indicate 
the row 31b (step S55) , and the program returns to the step S34 . 
However, if the value y does not indicate the row 31a (i.e. if 
the answer at the step S53 is NO) , it is determined whether or 
not the value y indicates the row 31b (step S54) . If the value 
Y indicates the row 31b (if the answer is YES), the value y is 
changed to indicate the row 31c (step S56) , followed by the 
program returning to the step S32. Thus, thetfh-shaped 
distribution is determined. 

However, in the determination offi-shaped distribution 
described so far, it is possible that the distribution has a QQ 
shape. In light of this, it is necessary to confirm whether 
the x-coordinate of a leading edge is lower than that of a 
trailing edge. Specifically, the x-coordinate X23ia of the 
trailing edge is compared with that xi3i^ of the leading edge 
(step S57) . Unless X23ia > ^131a (i-e. if the answer is NO), 
the width of the fi-shape is set at 0 (step S58), whereas if 
the answer is YES, the width Ax3ia of the£b-shape is 
calculated as the difference between the x-coordinates of the 
leading and trailing edges (step S59) . 

Similarly, it is confirmed that the x-coordinate X23ib or 
X23ic of a trailing edge is lower than that ^i3ih or ^i3ic of a 
leading edge (step S60 or S63) . If the answer is NO, the width 
of the i£b-shape is set at 0 (step S61 or S64), whereas if the 
answer is YES, the width Ax3ib or Ax3ic of theifb shape is 
calculated as the difference between the x-coordinates of the 
leading and trailing edges (step S66 or S67) . 

It is determined whether or not the widths seguentially 
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increase Ax3ia ^ ^^31h < ^^31c (steps S66 and S67) . If this 
formula is not satisfied (i.e. if the answer at the step S66 or 
S67 is NO) , it is determined that no head or shoulder of a 
person is detected from an upper portion of the photography 
screen as shown in FIGS. 8(c) and 8(d), thereby executing 
distance measurement at the center of the photography screen 
(step S68), followed by the program returning to the start (it 
is controlled so as to determine the answer at the step S13 in 
FIG. 7 is NO) . 

On the other hand, if it is determined at the steps S66 
and S67 that the widths sequentially increase Ax3ia ^ Ax3ib < 
Ax3ic (i-e. if the answers at the steps S66 and S67 are YES), 
it is determined whether or not any i£b shape is detected at the 
middle row 31b (step S69) . If any ifh shape is not detected (A 
X31b = 0) (i-e- if the answer at the step S69 is YES), it is 
determined that the to-be-photographed scene is a scene as 
shown in FIG. 3(d), thereby chiefly executing distance 
measurement at a point (x: substantially the center of a 
shape, y: the row 31c or a row near it) (step S70) . On the 
other hand, if a ifli shape is detected (i.e. if the answer at 
the step S69 is NO) , it is determined that the to-be- 
photographed scene is a scene as shown in FIG. 3(C), thereby 
chiefly executing distance measurement at a point (x: 
(X231a+xi3ia) /2, i.e. the center of the t£b shape, y: the row 
31b) (step S71) . 

Thus, after the step S70 or S71, the program returns to 
the step S13 of FIG. 7. 

FIG. 7 will be further described. 
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If, at the step S13, the image pattern cannot be 
determined to be a main subject, i.e. if the position of a main 
subject cannot be determined (if the answer is NO), one of the 
active type method and the passive type method is selected in 
light of, for example, brightness information, thereby chiefly 
executing distance measurement at a central portion of the 
photography screen, at which it is highly probable that a main 
subject will exist (step S14) . 

In this determination, it is sufficient if, for example, 
the active type method is selected when the edge-height APq of 
the tfh shape is high and hence the effect of light projection 
is considered high. This processing enables automatic 
detection of a person not only in a scene as shown in FIG. 8 (c) 
but also in a scene as shown in FIG. 8(d). Accordingly, it can 
be determined at the step S13 of FIG. 7 whether or not the 
subject is a person. 

At the same time, the CPU 28 selects, from pre-stored 
patterns, a message pattern indicating that the position of the 
main subject cannot be determined and hence distance 
measurement is executed at a central portion of the photography 
screen, thereby warning the user using a voice generating 
section 29 (step S15) . 

On the other hand, if the image pattern is determined to 
be a main subject at the step S173 (i.e. the answer at the step 
S13 is YES) , it is determined whether distance measurement 
should be executed by the active type method or the passive 
type method, on the basis of the intensity or the contrast of 
an image signal (light signal) for forming the image pattern 
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(step S16) . 

If the image signal (light signal) does not provide a 
sufficient contrast (i.e. if the answer at the step S16 is YES), 
distance measurement is executed using the active type method . 
Accordingly, the projecting section 22 again projects light 
onto the subject 21 while the fixed-light eliminating circuit 
30 is operated, thereby eliminating fixed light from a 
ref lected-light signal entering the area sensors 26a and 26b to 
extract only an image signal contained in the ref lected-light 
signal (step S17) . Then, active-type distance measurement is 
chiefly executed in the position of the main subject determined 
by the pre-emission process (step S18) . At this time, the 
liquid crystal display provided in the viewfinder may be 
controlled so as to display the selected subject position as a 
target as shown in FIG. 12 (step S19) . 

If it is determined at the step S16 that the image signal 
is weak (i.e. if the answer is NO), distance measurement is 
executed using the passive type method in which an image signal 
from the already detected main subject position is chiefly used 
(step S20) . At this time, the liquid crystal display in the 
viewfinder may display the selected subject position as shown 
in FIG. 11. 

In accordance with the distance measurement method or the 
determination as to whether or not a main subject is detected, 
the CPU 28 selects the way of display and informs the user of 
the selected result, whereby the conditions for photography 
will be understandable and hence reliable distance measurement 
can be executed. 
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As described above, in the embodiment, the combination of 
the active type method and the passive type method enables 
accurate detection of a main subject. Various types of simple 
methods can be used to detect whether or not light received by 
a sensor is that reflected from a subject. 

Referring to FIG. 13, a description will be first given 
of how more highly accurate distance measurement is executed 
when the sensor for distance measurement has a finer pitch. 

When, for example, calculating the relative positional 
difference between the outputs (image signals) of two sensor 
arrays {12a and 12b in FIG. 1) of a distance-measuring device, 
the difference (correlation) between the two sensors is 
calculated while displacing the two sensor outputs in units of 
one pitch as shown in FIGS. 13(a), 13(b) and 13(c). Since the 
sum (correlation function) of the differences is minimum when, 
the two outputs are identical to each other (FIG. 13(b)), the 
amount of displacement can be determined. 

In the case shown in FIG. 13, the sum of differences is 
"0" when the relative displacement is "1". Actually, the 
correlation between the two outputs is maximum when the 
displacement is between "0" and "1". However, the finer the 
pitch, the more it is difficult to obtain such an intermediate 
value. Therefore, it is necessary to increase the accuracy of 
A/D conversion as much as possible. As a result, the degree of 
accuracy of displacement determination and the accuracy of the 
distance measuring function are enhanced. 

However, a lot of time is required to accurately detect 
each sensor output. Moreover, when detecting the position of a 
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main subject from a wide area in the photography screen, if 
each sensor is made to capture an image signal at the same high 
accuracy and resolution as in the case of distance measurement, 
the time lag inevitably much more increases. In light of this, 
it is necessary to more reduce the image signal processing 
period of each sensor when a wider area is to be scanned. 

To this end, a method, as aforementioned, for degrading 
the accuracy of A/D conversion to increase the processing speed, 
or a method for roughening the image capture pitch may be used. 

When, in the latter method, capturing an image indicated 
by reference numeral 2a' and included in a scene as shown in 
FIG. 14(a), it is sufficient if a fine pitch as shown in FIG. 
14(c) is used for distance measurement, and a rough pitch as 
shown in FIG. 14(b) is used for subject determination. 

On the other hand, where, in the former method, a sensor 
array is formed of sensors 41 - 44 as shown in FIG. 15, the 
outputs of the sensors 41 and 43 are added to the outputs of 
the sensors 42 and 44, respectively, and then integrated. 

Since, in this method, integration circuits 45 and 46 do 
not execute integration processing, a CPU 61 reads, via an A/D 
converter 10, only the outputs of integration circuits 47 and 
48, which are each obtained by integrating the sum of the 
outputs of adjacent sensors. As a result, the time required 
for monitoring image signals from the entire to-be-photographed 
area is reduced by half. 

The CPU 1 uses a switch section 49 to control switches 50, 
51 and 52 so as to switch the roughness of an image between 
subject determination processing and distance measurement 
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processing . 

Referring to the flowchart of FIG. 14(a), image capture 
processing using the summation/integration of sensor outputs 
will be described. 

First, the sum of the outputs of adjacent pixels 
(sensors) is integrated as aforementioned (step S81), and the 
integration value is subjected to A/D conversion (step S82) . 

From an image signal obtained by the A/D conversion, a 
main subject is detected (step S83) . The output of each sensor 
is integrated (step S84), and the resultant integration value 
is subjected to A/D conversion (step S85) . After that, 
distance measurement is executed using the active type method 
or the passive type method (step S86) , thereby executing 
focusing on the basis of the distance measurement result (step 
S87) . 

Referring to the flowchart of FIG. 16(b), a description 
will be given of image capture processing using sensors 
selected by skipping. 

First, the output of each sensor is integrated (step S91) . 
Subseguently, only the integration values of sensors arranged 
in even rows are subjected to A/D conversion (step S92), 
thereby detecting a main subject from the A/D converted image 
signal (step S93) . After the area of the main subject is more 
narrowed, the integration values of sensors arranged in both 
odd and even rows in the area are subjected to A/D conversion 
(step S94) . Thereafter, active type or passive type distance 
measurement is executed (step S95) , thereby executing focusing 
based on the distance measurement result (step S96) . 
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As described above, when detecting a main subject, the 
outputs of only sensors arranged in even rows may be subjected 
to A/D conversion, and after the area of the subject is 
narrowed, the outputs of sensors arranged in even and odd rows 
in the narrowed area may be subjected to A/D conversion. 

In the above-described embodiment, high-speed main 
subject detection can be executed by switching the accuracy of 
image determination. 

A third embodiment of the invention will now be described, 
This embodiment is a modification of the second 
embodiment, in which the roughness of the pitch of two- 
dimensionally arranged pixels (sensors) is changed. 

In this embodiment, the position of a main subject is 
determined by sensors arranged with a rough pitch, as shown in 
FIG. 17(a), while only a predetermined portion (e.g. face) of 
the main subject is detected with high accuracy as shown in 
FIG. 17(b). FIG. 18 shows an example of a switch circuit for 
switching the roughness of the pitch. 

In this structure, sensors 51a, 51b - 55a, 55b are 
arranged in two rows a and b, switch groups SW 56a, 56b - 57a, 
57b are arranged on opposite sides of each of the sensors, and 
integration circuit groups 58a and 58b are opposed to the 
sensors with the switch groups SW 56a, 56b interposed 
therebetween . 

The structure of this embodiment further comprises an A/D 
converter 59a for A/D converting the integration value of each 
sensor 51a - 55a, a sum/integration circuit 60 for summing the 
outputs of the sensors 51a - 55a and 51b - 55b and integrating 
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the summing result, an A/D converter 59b for A/D converting the 
integration result, a CPU 61 for computing the results of the 
A/D converters 59a and 59b, and a switch circuit 62 for 
switching the switch groups SW 56a, 56b, 57a and 57b under the 
control of the CPU 61. 

In this structure, the outputs of the sensors are 
individually subjected to A/D conversion with the switch groups 
SW 56a and 56b kept on and the switch groups SW 57a and 57b 
kept off, or the outputs of the sensors are added and 
integrated by the sum/integration circuit 60 (with the switch 
groups SW 56a and 56b kept off and the switch groups SW 57a and 
57b kept on) , or the CPU 61 switches the pitch roughness or the 
area for image detection in accordance with the situation. 

As described above, the third embodiment can realize more 
efficient and faster main subject determination by two- 
dimensionally switching the roughness of an image. 

An fourth embodiment of the invention will be described. 

FIG. 19 shows a structure obtained by further developing 
the third embodiment. In this structure, one of simple 
integration control and compression control is selectively 
executed on the output of each sensor. 

Also in this structure, sensors 71 - 75 are arranged, 
integration circuits 77a - 77e are respectively connected to 
ends of the sensors 71 - 75 via respective switches SW 76a that 
operate simultaneously, and the integration outputs of the 
integration circuits are supplied to an A/D converter 78a. The 
other ends of the sensors 71 - 75 are respectively connected to 
compression circuits 79a - 79e via respective switches SW 76b 
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that operate simultaneously. The compression outputs of the 
compression circuits are supplied to an A/D converter 78b. 

Referring to the flowchart of FIG. 20, the operation of 
the above structure will be described. 

First, the switch SW group 76a is turned off and the 
switch SW group 7 6b are turned on, thereby causing the outputs 
of the sensors 71 - 75 to be output to the compression circuits 
79a - 79e, respectively (step SlOl) . Sensor outputs obtained 
by logarithmic compression of the compression circuits 79a - 
79e are output to a CPU 80 via the A/D converter 78b (step 
S102) . The CPU 80 detects a main subject on the basis of the 
sensor outputs (step S103) . 

Subsequently, the switch SW group 7 6a is turned on and 
the switch SW group 76b are turned off, thereby selecting the 
integration circuits 77a - 77e. Sensor outputs obtained by 
integration are output to the CPU 80 via the A/D converter 78a 
(step S104) . The CPU 80 detects a main subject on the basis of 
the sensor outputs (step S105) . After that, distance 
measurement is executed using one of the active type method and 
the passive type method (step S106) , thereby executing focusing 
on the basis of the distance measurement result (step S107) . 

When, as described above, the switch SW group 76a is 
selected, linear integration outputs, known in the prior art, 
are supplied to the CPU 80 via the A/D converter 78a. On the 
other hand, when the switch SW group 76b is selected, the 
sensor outputs are subjected to logarithmic compression using 
the I/V distinctive of, for example, diodes. As a result, the 
sensor outputs are supplied in the form of non-linear outputs. 
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which increase by one step each time the input signal level is 
doubled, to the CPU 80 via the A/D converter 78b. 

Since the non-linear output significantly widens the 
dynamic range of the sensor although it degrades its accuracy, 
it is very effective when a to-be-photographed scene with a 
high contrast as shown in FIG. 21(a) is subjected to whole 
image determination. In other words, when an image has 
significant differences in terms of accuracy, accurate image 
data can be obtained from only part of the image as shown in 
FIG. 21(b), if linear integration is executed. However, if a 
non-linear output circuit is used, it can provide an output 
distribution corresponding to a wide brightness distribution as 
shown in FIG. 21(c). Accordingly, when detecting a main 
subject, non-linear processing is preferable. 

In light of this, when in this embodiment, detecting a 
main subject in a to-be-photographed scene as shown in FIG. 
21(a), a logarithmic compression type output circuit is used, 
which has a relatively low accuracy but a wide dynamic range. 
On the other hand, when executing distance measurement in a 
specified area (e.g. a face as shown in FIG. 17(b)), an 
integration circuit is used, which has a narrow dynamic range 
but a highly-accurate linear output distinctive, thereby 
executing highly accurate distance measurement. This switching 
of processing enables determination of a main subject at a high 
speed, and also enables selection, from a wide area, of a 
narrow area in which distance measurement is to be executed, 
and execution of highly accurate focusing on the selected area. 
In addition to the above-described embodiments, the 
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present invention described in this specification includes the 
following version . 

That is, A distance-measuring device comprising a 
sensor array and capable of executing distance measurement 
at a plurality of points in a photography screen, 
comprising : 

a first A/D conversion mode configured to identify 
the characteristic point of an image at each point within 
the scene; 

a second A/D conversion mode configured to determine 
the distance to the image at each point within the scene; 
and 

switching means configured to switch the resolution 
of the sensor array from one position to another in 
response to the first and second operation modes in the 
distance measuring sequence. 

The distance measuring device according to above (1), 
wherein the switching means switches the resolution from one 
position to another by adding output values of pixels adjacent 
to each other in the sensor array or invalidating them. 
[Advantage of the Invention] 

According to the present invention, as described 
above in detail, there is provided a distance-measuring 
device which identifies an object the distance to which 
is to be measured in a photography scene before the 
measurement of the distance, and determines the distance 
measuring point to the main object to be photographed, 
thus making it possible to deal with various situations 
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without increasing the production cost. Further, 
according to this distance measuring device, the data 
reading modes are switched over between the 
identification of the main object and the measurement of 
the distance thereto, thereby achieving a higher speed 
operation and higher accuracy. 
[Brief Description of the Drawings] 
[FIG. 1] 

FIG. 1 is a flowchart useful in explaining a distance- 
measuring device, using the principle of triangular distance 
measurement, according to a first embodiment of the invention; 

[FIG. 2] 

FIG. 2 is a view useful in explaining the distance- 
measuring device, using the principle of triangular distance 
measurement, according to the first embodiment of the 
invention; 

[FIG. 3] 

FIG. 3 is a view illustrating the relationship between a 
line sensor output and a subject; 
[FIG. 4] 

FIG. 4 is a view illustrating the relationship between a 
distance-measuring area and a to-be-photographed scene; 
[FIG. 5] 

FIG. 5 is a view useful in explaining the concept of a 
distance-measuring device, according to a second embodiment, 
for detecting the position of a main subject at high speed; 

[FIG. 6] 

FIG. 6 is a view illustrating a conceptual structure of 
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the distance-measuring device of the second embodiment, and an 
image formed on an area sensor; 
[FIG. 7] 

FIG. 7 is a flowchart useful in explaining distance 
measurement executed by the distance-measuring device according 
to the second embodiment of the invention; 

[FIG. 8] 

FIGS. 8 is a view illustrating the relationship between 
sensor strings incorporated in an area sensor and a photography 
screen; 

[FIG. 9] 

FIG. 9 is first part of a flowchart useful in explaining 
subject pattern determination; 
[FIG. 10] 

FIG. 10 is second part of the flowchart useful in 
explaining the subject pattern determination; 
[FIG. 11] 

FIG. 11 is a view showing an example of a subject 
displayed on a liquid crystal display in the viewfinder of a 
camera; 

[FIG. 12] 

FIG. 12 is a view showing another example of the subject 
displayed on the liquid crystal display in the viewfinder of 
the camera; 

[FIG. 13] 

FIG. 13 is a view illustrating two sensor outputs (image 
signals) and amounts of deviation therebetween; 
[FIG. 14] 
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FIG. 14 is a view illustrating image signals input with 
fine pitch and a rough pitch; 
[FIG. 15] 

FIG. 15 is a view showing an example of a structure for 
selecting a sensor string to switch over a pixel pitch; 
[FIG. 16] 

FIG. 16 is a flowchart useful in explaining operations 
for switching over the pixel pitch; 
[FIG. 17] 

FIG. 17 is a view useful in explaining accuracies of th 
positions of a main subject during determination and during 
distance measurement; 

[FIG. 18] 

FIG. 18 is a view showing an example of a structure of 
switch circuit for switching over a pixel pitch; 
[FIG. 19] 

FIG. 19 is a view showing an example of a structure of 
switch circuit incorporated in a distance-measuring device 
according to a third embodiment of the invention; 

[FIG. 20] 

FIG. 20 is a flowchart useful in explaining a switchove 
operation of the switch circuit incorporated in the distance 
measuring device according to the third embodiment of the 
invention; and 

[FIG. 21] 

FIG. 21 is a view showing an example of a to-be- 
photographed scene in which bright portions are a sharp 
contrast to dark portions, and its data. 
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[Explanation of Reference Symbols] 
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[ DOCUMENT ] ABSTRACT 
[Abstract] 

[Object] If the photographing sensor array is used also for 
the sensor unit for measuring the distance in a conventional 
distance-measuring device, it can be achieved without adding 
new parts or securing a space. However, the accuracy of the 
pattern detection for detecting a characteristic point becomes 
excessively high, which creates a waste of time in processing. 

[Means for Achieving the Object] The present invention is a 
distance measuring device comprising a sensor array, the pitch 
of the pixels of which is set to be rough when identifying an 
object of distance measurement, and the pitch of the pixels of 
which is set to be fine when measuring the distance to the 
object. Or the invention is a distance-measuring device in 
which the switching of the pixel pitch is carried out by 
reading out the pixels in a thinning out manner, or reading 
out them while adding adjacent pixel signals. 
[Elected Figure] FIG. 1 
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[Document] SPECIFICATION 

[Title of the Invention] DISTANCE-MEASURING DEVICE 

[What is claimed is:] 

[Claim 1] A distance-measuring device comprising: 
two optical systems having a parallax therebetween; 
an image pick up element formed on a semiconductor 
substrate for pick upping two images formed by the optical 
systems; 

image processing means formed on the semiconductor 
substrate for processing an image output from the image pick up 
element; and 

distance-measuring means for executing a distance 
measurement operation, based on the output of the image 
processing means. 

[Claim 2] A distance-measuring device comprising: 
two optical systems having a parallax therebetween; 
an image pick up element formed on a semiconductor 

substrate for pick upping two images formed by the optical 

systems; 

image processing means formed on the semiconductor 
substrate for processing an image output from the image pick up 
element; 

main subject detecting means for detecting a main subject 
on the basis of an output from the image processing means; and 

distance-measuring means for executing a distance 
measurement operation, based on the output of the image 
processing means, on the main subject detected by the main 
subject detecting means. 
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[Claim 3] The distance-measuring device according to 
claim 2, wherein the processing means has a plurality of modes, 
and can individually set an output for the main subject 
detecting means and an output for the distance-measuring means. 
[Detailed Description of the Invention] 

[0001] 

[Filed of the Invention] 

The present invention relates to a distance measuring 
device that can be used in a camera or the like. 
[0002] 
[Prior Art] 

In general, a camera incorporates a distance-measuring 
device for measuring a distance to a subject when pick upping 
the subject so as to focus the photography lens of the camera 
on the subject. 

[0003] 

An active-autof ocusing system for applying infrared light 
to a subject to measure a distance thereto from light reflected 
therefrom (to execute distance measurement) , and a passive- 
autofocusing system for integrating outside light from a 
subject to measure a distance thereto, are known as distance- 
measuring devices. These devices generally employ a line 
sensor or an area sensor as a photoelectric conversion element 
for receiving image from the outside and converting it into an 
electric signal. 
[0004] 

An artificial retinal LSI device is known as an image 
processing device using such an area sensor. In this device. 
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an area sensor having two light receiving areas that are 
positioned to provide a parallax therebetween, and an image 
processing circuit for executing various types of data 
processing on an image signal from the area sensor are mounted 
in a signal IC chip. The image processing circuit executes 
edge emphasizing (detection) , smoothing, one-dimensional 
projection, etc. 
[0005] 

Japanese Patent Application KOKAI Publication 
No. 8-178637, for example, discloses an image processing device 
using an artificial retinal LSI, as the artificial retinal LSI 
device , 

[0006] 

This image processing device extracts the outlines of 
input images, using an artificial retinal element, calculates, 
at high speed, correlation between outline data on those 
portions of the outline images, which are located at the same 
scanning lines, using a correlation computing device 
incorporating a synapse connection computing circuit, and 
obtains information such as a distance to an object or movement 
of the object, on the basis of the computing result. 

[0007] 

[Object of the Invention] 

However, when the image processing device having the 
artificial retinal LSI disclosed in Japanese Patent Application 
KOKAI Publication No. 8-178637 is used in a camera, a CPU, 
which operates at high speed to execute complicated processing, 
and/or a correlation calculation unit must be mounted in the 



camera. These units are expensive, and the number of component 
parts of the distance-measuring device and hence the size of 
the distance-measuring device inevitably increased because of 
these units. 
[0008] 

iXIoreover, in the above distance-measuring device, two 
images are input using two cameras having respective artificial 
retinal LSIs, and the distance to a subject is measured, i.e. 
distance measurement is executed, on the basis of the 
correlation of the two images using the principle of stereo. 
Accordingly, the device is large in size and expensive. 
[0009] 

This large distance-measuring device can be installed in, 
for example, a single lens reflex camera, but not in a small 
and cheap machine such as a compact camera. 

[0010] 

It is the object of the invention to provide a highly- 
accurate, short-time-lag, compact and cost-effective distance- 
measuring device, which incorporates an AF area sensor that 
includes an image pick up element formed on a semiconductor 
substrate for receiving two input images having a parallax 
therebetween. 

[0011] 

[Means for Achieving the Object] 

In order to achieve the above-described object, there is 
provided, according to an aspect of the present invention, a 
distance-measuring device comprising: two optical systems 
having a parallax therebetween; an image pick up element formed 



on a semiconductor substrate for pick upping two images formed 
by the optical systems; image processing means formed on the 
semiconductor substrate for processing an image output from the 
image pick up element; and distance-measuring means for 
executing a distance measurement operation, based on the output 
of the image processing means. 
[0012] 

According to another aspect of the invention, there is 
provided a distance-measuring device comprising: two optical 
systems having a parallax therebetween; an image pick up 
element formed on a semiconductor substrate for pick upping two 
images formed by the optical systems; image processing means 
formed on the semiconductor substrate for processing an image 
output from the image pick up element; main subject detecting 
means for detecting a main subject on the basis of an output 
from the image processing means; and distance-measuring means 
for executing a distance measurement operation, based on the 
output of the image processing means, on the main subject 
detected by the main subject detecting means. 

[0013] 

The distance-measuring device having the above-described 
structure picks up two images formed by the optical systems 
having a parallax therebetween, and processes an image signal 
output from the image pick up element by the processing means 
provided on the same semiconductor substrate. Then, the device 
outputs the processed signal as sensor data (outline date) to 
the main subject detecting means. The main subject detecting 
means detects a main subject within the image picked up based 
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on the sensor data, and sets a distance measurement area that 
includes this main subject, so as to calculate the distance. 
In this manner, the position of the focus lens of the camera in 
which the device is installed is controlled. 
[0014] 

[Embodiments of the Invention] 

The embodiments of the invention will be described in 
detail with reference to the accompanying drawings. 
[0015] 

FIG. 1 schematically shows a camera equipped with a 
distance-measuring device according to a first embodiment. 
[0016] 

This camera comprises: a control section 1 formed of a 
microcomputer for controlling components parts mentioned below 
and executing various operations; an AF area sensor 2 used for 
distance measurement; a focus lens driving section 3 for 
driving a focus lens 4; a focus lens encoder 5 for generating a 
pulse signal corresponding to the movement amount of the focus 
lens 4; a photometric section 7 for processing a photoelectric 
signal generated by a photometric photoelectric element 6, and 
outputting a photometry result; a shutter driving section 8 for 
driving a shutter (not shown) ; a strobe circuit section 10 for 
causing a strobe emission unit 9 to emit light as assisting 
light during photography or as AF assisting light during 
distance measurement; a viewfinder display section 11 for 
superimposing information related to the invention on a 
viewfinder screen including a photography screen; a camera 
display section 12 provided on the case of the camera and 



formed of, for example, an LCD, for displaying the number of 
film portions to be exposed, or a photography mode; a display 
circuit section 13 for controlling the viewfinder display 
section 11 and the camera display section 12; a zoom lens 
driving section 15 for driving a zoom lens 14 to execute 
zooming (changes in focal distance) and outputting focal 
distance data to the control section 1; a film feeding section 

16 for executing auto-loading of a film, winding the film by 
one exposure, or rewinding the film; and a position detecting 
section 21 for detecting the position of the camera (a 
landscape-size picture taking position, a portrait-size picture 
taking position) . 

[0017] 

The control section 1 is connected to a first release 
switch (IRSW) 17 and a second release switch (2RSW) 18. The 
control section 1 executes distance calculation when the IRSW 

17 has been turned on, and executes an exposure operation and a 
film winding operation when the 2RSW 18 has been turned on. 

[0018] 

The control section 1 includes a central processing unit 
(CPU) la; a ROM lb that stores a sequence of programs relating 
to photography; a RAM Ic for storing necessary data in a 
rewritable manner; an A/D converter Id for converting, into a 
digital signal, an analog signal indicating, for example, a 
photometric output from the photometric section 7; and an 
EEPROM le that stores, for example, correction data for each 
camera related to auto-focusing (AF) , photometry/ exposure 
operations, etc., and various parameters used for detecting a 
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main subject in a photography screen, which will be described 
later . 

[0019] 

The AF area sensor 2 has a photoelectric element group 2a 
in which a plurality of pixel units including, for example, 
photodiodes, are two-dimensionally arranged in rows and columns 
in its photography area; a light signal processing circuit 2b 
and a fixed light eliminating section 2c. In this structure, 
the control section 1 controls an integration operation, 
thereby pick upping a subject image formed by a distance- 
measuring optical system, described later, controlling a pixel 
amplifying circuit for each pixel so as to convert, into a 
voltage, a charge generated by the photoelectric element group 
2a when light has entered it, and to amplify it and convert it 
into sensor data. The fixed light eliminating section 2c 
eliminates a fixed light component from the sensor data, and 
outputs the resultant data to the control section 1. 

[0020] 

The control section 1 then executes distance calculation 
on the basis of the input sensor data, thereby outputting a 
driving signal to the focus lens driving section 3, monitoring 
the output of the focus encoder 5, and adjusting the position 
of the focus lens 4 . 

Referring then to the flowchart of FIG. 2, a main routine 
executed during photography will be described. 

When a power switch SW (not shown) or a battery (not 
shown) has been turned on, the control section 1 is excited to 
start its operation in accordance with the sequence of programs 
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pre-stored in the ROM lb. 

First, each block in the camera is initialized, and then 
adjustment/correction data, stored in the EEPROM le and related 
to auto-focusing (AF) or distance measurement, is developed in 
the RAM Ic (step SI) . 

[0021] 

Subsequently, it is determined whether or not the IRSW 17 
has been turned on (step S2) . If it is determined that the 
IRSW 17 is in the OFF state (if the answer at the step S2 is 
NO) , it is determined whether or not another switch (other than 
the IRSW 17 and the 2RSW 18) has been operated (step S3) . 

If another switch is operated (if the answer at the step 
S3 is YES), processing corresponding to the operated switch is 
executed (for example, if a ZUSW 19 or a DSW 20 is operated, 
the zoom lens 14 is raised or lowered) (step S4), and the 
program returns to the step S2 . On the other hand, if another 
switch is not operated (if the answer at the step S3 is NO) , 
the program directly returns to the step S, thereby keeping the 
camera in a standby state. 

[0022] 

If it is determined at the step S2 that the IRSW 17 has 
been turned on (the answer is YES) , distance measurement is 
executed (step S5), and photometry/exposure operations are 
executed (step S6) . 

After that, it is determined whether or not the 2RSW 18 
has been turned on (step S7). If it is determined that the 
2RSW 18 has been turned on (if the answer at the step S7 is 
YES) , a shutter operation is executed to expose a portion of a 
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film (step S8). After exposing the film portion, the film is 
wound by one exposure (step S9) , followed by the program 
returning to the step S2 to thereby keep the camera in the 
standby state. However, if it is determined that the 2RSW 18 
is not turned on (if the answer at the step S7 is NO) , the 
program directly returns to the step S2. 
[0023] 

FIGS. 3(a) and 3(b) show a conceptual structure of a 
distance-measuring optical system of the passive type using 
outside light. 

In this structure, light for distance measurement is 
guided to a light receiving area of the AF area sensor 2, in 
which the photoelectric element group 2a is arranged, and light 
receiving lenses 31 and 32 for measuring a distance to a 
subject 33 are located with a base length B interposed 
therebetween. 

[0024] 

In this structure, light for distance measurement is 
guided to a light receiving area of the AF area sensor 2, in 
which the photoelectric element group 2a is arranged, and light 
receiving lenses 31 and 32 for measuring a distance to a 
subject 33 are located with a base length B interposed 
therebetween . 

The light receiving lenses 31 and 32 divide an image of 
the subject 33 into two images and form one image on the 
photoelectric element group 2a of the AF area sensor 2. On the 
basis of the principle of triangular distance measurement, the 
relative positional difference x between the two images, the 
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focal distance f of the lenses and the base length B, and the 
distance L to the subject satisfy the following equation: 
L = (B • f ) /x 

This distance calculation is executed by the control 
section 1. Specifically, a distance-measuring block is set in 
the light receiving area 2a of the AF area sensor 2, and 
correlation operation is executed using sensor data 
corresponding to the two images, thereby detecting the relative 
positional difference x therebetween. 

[0025] 

FIG. 4 shows an example of a specific structure of the AF 
area sensor 2. 
[0026] 

As shown in FIG. 4, the AF area sensor 2 comprises: pixel 
areas 34 and 35 (included in the photoelectric element group 
2a) for receiving distance measurement light converged by the 
light receiving lenses 31 and 32 shown in FIG. 3(a); vertical 
control circuits (VC) 36 and 37 functioning as control 
scanners; a horizontal control circuit (HC) 38 functioning as a 
multiplexer; an output circuit (OC) 39; and a control circuit 
(SC) 40 for controlling the operation of the AF area sensor 2 
under the control of the control section 1. These areas and 
circuits are formed on a single silicon substrate by the CMOS 
process, and the light receiving lenses 31 and 32 are 
integrally mounted thereon. 
[0027] 

Each photoelectric element in the pixel areas 34 and 35 
is formed of a photodiode PD as a light receiving section, a 
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differential amplifying circuit SA and a reset transistor RT, 
and has sensitivity control input terminals DP and DN and a 
reset terminal RS connected to the vertical control circuits 36 
and 37. Output terminals Nout of the photoelectric elements of 
each column are connected to each other and also to the 
horizontal control circuit 38. Further, the sensitivity 
control input terminals DP of the photoelectric elements of 
each row are connected to each other. Similarly, the 
sensitivity control input terminals DN (or the reset terminals 
RS) of the photoelectric elements of each row are connected to 
each other. 
[0028] 

The reset terminal RS is provided for resetting the 
potential at the PD to a predetermined potential. After the 
potential at the PD is reset to the predetermined potential by 
a reset pulse Vr, a signal corresponding to the intensity of 
incident light is accumulated during a charge accumulating 
period until a readout pulse is input, whereby the potential 
reduces in accordance with the amount of the incident light. 

[0029] 

FIG. 5 shows a specific structure of the differential 
amplifying circuit SA. 
[0030] 

The differential amplifying circuit SA comprises NMOS 
transistors TA, TP, TN, TO and TI connected by current mirror 
connection. 

Further, a photodiode PD and a reset transistor RT are 
connected in series, while the cathode of the photodiode PD is 
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connected to the gate of the current control transistor TA. 
[0031] 

The potential of the photodiode PD of each pixel is read 
by operating the gate of the current control transistor TA of 
the differential amplifying circuit SA. Positive and negative 
current outputs proportional to the potential of the photodiode 
PD of each pixel are obtained from the output terminal Nout by 
supplying control signals VP^ VN to the sensitivity control 
terminals DP and DN of each pixel, respectively. 

[0032] 

If no voltage is applied to the sensitivity control 
terminals DP and DN, the current output of the pixel becomes 0. 
When applying "1" and "0" to the sensitivity control terminal 
DP for controlling a positive output current, and the 
sensitivity control terminal DN, respectively, thereby turning 
on the transistor TP and turning off the transistor TO, a 
current corresponding to the potential of the sensitivity 
control terminal PD is output from the output terminal Nout via 
the transistors TA and TP. 

[0033] 

On the other hand, when applying "1" and "0" to the 
sensitivity control terminal DN for controlling a negative 
output current, and the sensitivity control terminal DP, 
respectively, thereby turning on the transistor TN and turning 
off the transistor TP, a current corresponding to the potential 
of the sensitivity control terminal PD is guided to the 
transistors TA and TI, and is returned by a current mirror. 
After that, a current corresponding to the potential of the 
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photodiode PD is received by the transistor TO via the output 
terminal Nout. 
[0034] 

Since the output terminals Nout of pixels arranged in the 
same row are connected to each other, the current output Nout 
of the pixels are summed. 

Accordingly, where, as shown in FIG. 6, the pulse signal 
VP is applied to the third and fourth rows, and the pulse 
signal VN is applied to the second and fifth rows, the four 
pixels have the same values as obtained in the case of 
execution of filtering to multiply respective image data items 
entering the pixels by weighting coefficients (-1, 1, -1, 1). 

[0035] 

The aforementioned current output Nout is scanned and 
selected by the horizontal control circuit 38, converted into a 
voltage output by the output circuit 39, and input to the AD 
converter Id in the control section 1. Supposing that a 
sensitivity control signal vector is represented by S and the 
two-dimensional matrix of input image data is represented by W, 
a correlation signal W • S is obtained when the voltage output 
has been generated. 

[0036] 

Since sensitivity control data is transferred by the 
vertical control circuits 36 and 37, the sensitivity control 
signal S sequentially shifts in units of one bit. 

[0037] 

As a result, applying various pulse voltage signals VP, 
VN to the vertical control circuits 36 and 37 and executing 
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scanning enables detection of an image itself and also the 
outline of the image, resolution change, compression of two- 
dimensional data into one-dimensional one, etc. 
[0038] 

Specifically, a positive image (a usual image) can be 
obtained by seguentially shifting the sensitivity control 
signal vector S (1, 00, 0) to S (0, 1, 0, 0), S (00, 1, 

0) Further, the data difference between horizontally 

adjacent pixels can be obtained by sequentially shifting S (1, 
-1, 0, 0), whereby the horizontal outline of an image can 

be extracted. 
[0039] 

Moreover, shifting of S (1, 1, 0, 0) provides an 

output obtained by summing data of two pixels, thereby changing 
the resolution of an image. Similarly, in the case of S (1, 1, 
1^ 0, 0), data of three pixels are summed, thereby changing 

the resolution. 

[0040] 

In the case of S (1, 1, 1, 1), horizontal output 

signals are summed and one-dimensional projection data is 
obtained. A control section 40 sets the sensitivity control 
signal under the control of the control section 1. 

[0041] 

The manner of outline detection will be described in 
detail . 

FIGS. 6(a) and 6(b) show the conceptual relationship 
between the AF area sensor 2 and an input image. In the case 
shown in FIGS. 6(a) and 6(b), light enters an upper right 
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portion of the AF area sensor 2, and does not enter the lower 
left hatched portion of the sensor 2. 
[0042] 

When voltages "1" and "-1" as sensitivity control signals 
have been applied to sensitivity variable elements arranged in 
the first and second rows of the sensor 2, respectively, as 
shown in FIG. 6(a) (S (1, -1, 00, 0)), the outputs of those of 
the sensitivity variable elements of the first and second rows, 
at which the same light intensity is found, are summed in the 
column direction, and hence an output "0" is obtained from the 
first and third - fifth columns. 

[0043] 

On the other hand, an output "1" not "0" is obtained only 
from those of the sensitivity variable elements of the first 
and second rows, at which different light intensities are found 
(i.e. the output of the second column). In other words, part 
of an outline is detected. 

[0044] 

Subsequently, the voltages "1" and "-1" as the 
sensitivity control signals have been applied to sensitivity 
variable elements arranged in the second and third rows of the 
sensor 2, respectively, as shown in FIG. 6(b) (S (0, 1, -1, 
00)). Then, the outputs of those of the sensitivity variable 
elements of the second and third rows, at which the same light 
intensity is found, are summed in the column direction, and 
hence the output "0" is obtained from the first, second, fourth 
and fifth columns) . Further, the output "1" not "0" is 
obtained only from those of the sensitivity variable elements 
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of the second and third rows, at which different light 
intensities are found (i.e. the output of the third column). 
[0045] 

Repeating the scanning operation while sequentially 
shifting the rows, as described above, to which the control 
signal voltages are applied provides a matrix of output signals 
as shown in FIG. 6(c). 

[0046] 

Thus, part of an outline corresponding to one scanning 
line can be detected simultaneously in a parallel manner, 
thereby providing a matrix concerning outline data. 

[0047] 

FIG. 7 shows the relationship. between a distance- 
measuring area and the wide-end and telescopic-end sizes of a 
photography screen . 

[0048] 

Since this embodiment employs a distance-measuring system 
using outside light, a parallax exists between a zoomed 
photography screen and the distance-measuring area. 

[0049] 

In light of this, an area used for distance measurement 
is limited in accordance with the focal distance data (zoom 
data) of a photographic optical system. The EEPROM le pre- 
stores distance-measuring area position correction data 
corresponding to changes in focal distance, which is read and 
developed in the RAM Id when the control section 1 is 
initialized . 
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[0050] 

In accordance with a zooming operation by the zooming 
lens driving section, the correction data is referred to in 
order to determine a distance-measuring area, used for distance 
calculation, of the light receiving area of the AF area sensor 
2. On the basis of sensor data obtained in the distance- 
measuring area, distance calculation is executed. 

[0051] 

Further, the control section 1 supplies the AF area 
sensor 2 with a control signal for controlling the sensor 2 so 
as to generate an integration control peak monitor signal 
corresponding to the distance-measuring area. The AF area 
sensor 2, in turn, supplies the control section 1 with a peak 
signal in the designated distance-measuring area. The control 
section 1 adjusts the amount of integration to a predetermined 
value with reference to the monitor signal. 

[0052] 

This is done to prevent a subject from influencing the 
outside of the photography screen. Also when reading sensor 
data, distance-measuring area correction data corresponding to 
the photography screen is referred to, and unnecessary sensor 
data on the outside of the photography screen is ignored and 
not stored in the RAM Ic. Alternatively, a read area setting 
signal is output to the AF area sensor 2 so that only sensor 
data in the set area will be output. 

[0053] 

Referring then to the flowchart of FIG. 8, an AF routine 
executed in the distance-measuring device of this embodiment 
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will be described. 

First, an operation section incorporated in the camera is 
operated to set an outline detection mode for the AF area 
sensor 2 (step Sll) . 

[0054] 

Subsequently, the control section 1 outputs an 
integration control signal to the AF area sensor 2 to cause the 
sensor 2 to execute an integration operation (step S12) . The 
AF area sensor 2 outputs a monitor signal corresponding to a 
peak output (the output of a brightest pixel) in a 
predetermined area. Referring to the monitor signal, period of 
integration is controlled so that the amount of light received 
by the light receiving section 2a of the AF area sensor 2 will 
be an appropriate value. Integrated sensor data (outline data) 
is read from the AF area sensor 2 in accordance with a reading 
clock signal output from the control section 1, then subjected 
to A/D conversion executed by the AD converter Id, and stored 
in the RAM Ic. 

[0055] 

After that, the central processing unit la executes 
processing for extracting a main subject (step S13) . It is 
determined whether or not the extracted object is the main 
subject (step S14), thereby setting a distance-measuring area 
including the main subject and executing distance calculation 
(step S15) . 

[0056] 

On the basis of distance measurement data obtained by the 
distance calculation, the focus lens driving section 3 drives 
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the focus lens 4 (step S16) . 
[0057] 

Referring to the flowchart of FIG. 9, a main subject 
detection routine will be described. In this routine, a person, 
for example, is supposed to be a main subject, and a procedure 
for detecting the person will be described. Although two 
images are obtained by the AF area sensor 2, it is sufficient 
if at least one of the two images is used as image data (sensor 
data) for detecting the main subject. 

[0058] 

The sensor data obtained by the AF area sensor 2 is 
stored in the RAM Ic incorporated in the control section 1, and 
the following processing is executed on the basis of this 
sensor data. 

[0059] 

First, read sensor data is subjected to smoothing 
processing (step S21) . This smoothing processing is a process 
for eliminating random noise contained in an image by filtering 
processing or Fourier transform. This random noise is inherent 
in the AF area sensor 2 itself or caused by external noise that 
occurs, for example, when a power supply voltage supplied to 
the AF area sensor 2 fluctuates. 

[0060] 

After that, the to-be-binarized image is subjected to 
processing based on a predetermined threshold level, thereby 
extracting part of image data lower than the predetermined 
level to obtain a binary image (step S22) . 
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[0061] 

More specifically, the smoothing processing is processing 
for eliminating random noise contained in an image. This 
processing is executed by various methods. For example, it is 
effectively executed using a median filter for providing the 
median of pixel values in an area near a distance-measuring 
area, or using an edge reserving filter for dividing the area 
near the distance-measuring area into small regions, obtaining 
variance in each small region, obtaining that one of the small 
regions which has minimum variance, and outputting the average 
value of variances. The edge reserving filter is more 
effective than the median filter, since the edge of an image 
can be maintained more sharp when using the former filter . 
Further, Fourier transform may be used to execute the smoothing 
processing, in place of using these filters. 

[0062] 

Then, the central processing unit la executes labeling 
and figure combining processing on the binary image (step S23) , 
thereby obtaining a figure having a certain width corresponding 
to an edge obtained by line thinning processing (step S24) . 
The line width of this figure is reduced to about 1, using line 
thinning algorithm. 

[0063] 

Subsequently, the shape of the image is determined by 
shape determination processing, described later, thereby 
extracting the main subject (step S25) . 

[0064] 

Referring now to the flowchart of FIG. 10, binarization 



- 22 



processing (processing based on a threshold level) will be 
described. 

First, a histogram is created which indicates the 
appearance frequency of each of pixel values corresponding to 
respective brightnesses of an image (step S31) . 

[0065] 

Subsequently, a threshold level is set on the basis of a 
threshold level setting histogram (step S32) . Various methods 
can be used for this setting. For example, if a mode method is 
used, the brightness that appears at a minimum frequency is set 
at the threshold level in a case as shown in FIG. 11(a), 
thereby executing binarization processing based on the 
threshold level (step S33) . 

[0066] 

The threshold level can be set by other methods such as a 
p-tile method that is effectively used when the area of a to- 
be-extracted figure is roughly known in advance, a differential 
histogram method for setting a threshold level so that a 
boundary portion of the figure will have the level, a 
determination analysis method for obtaining a parameter t that 
enables clear separation of two classes into which density 
levels are classified, or a method using a variable threshold 
level for changing a threshold level in accordance with a 
position on an image. These methods are selectively used, 
depending upon the situation. 

[0067] 

For example, the shape of a histogram is determined, 
thereby determining whether or not a definite minimum value 
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exists, and the mode method is employed if the definite minimum 
value exists. On the other hand, if it does not exist, the 
determination analysis method is employed. Thus, histogram 
shape determination is executed, and the threshold level 
setting method is changed on the basis of the determination 
result . 

[0068] 

Concerning the histogram shape determining method, an 
extreme and first minimum frequency value a and an extreme 
secondmost minimum frequency value b as shown in FIG. 11(b) are 
obtained, and the difference therebetween (b-a) is compared 
with a predetermined judgment value dth. If the difference is 
higher than the predetermined value dth, a brightness 
corresponding to the first minimum frequency value a is used as 
the threshold level. On the other hand, if the difference is 
lower than the predetermined value dth, the variable threshold 
level method for varying the threshold level in accordance with 
a position on an image is employed. 

Referring to the flowchart of FIG. 12, the threshold 
level setting processing will be described. 

[0069] 

First, the first minimum value a and the secondmost 
minimum value b are obtained (step S41) . Subsequently, it is 
determined whether or not the difference (b-a) is higher than 
the predetermined judgment value dth (step S42) . 

[0070] 

If it is determined that the difference (b-a) is higher 
than the judgment value dth (i.e. if the answer at the step S42 



is YES), a brightness Ba corresponding to the first minimum 
value a is employed (step S43) . However, if it is determined 
that the difference (b-a) is lower than the judgment value dth 
(i.e. if the answer at the step S42 is NO), the variable 
threshold level method is employed (step S44) . 
[0071] 

This embodiment may be modified as follows. At first, an 
image corresponding to the entire photography screen is 
binarized on the basis of a threshold level set by the mode 
method. If the estimation result of the resultant binary image 
is not satisfactory, the original image is divided into a 
plurality of blocks, and a histogram is created for each block, 
thereby setting a threshold level for each block. 

[0072] 

The labeling and figure combining processing will be 
described. 

Labeling is executed on a group of the continuous portion 
of an image, in which pixels of the same brightness are 
continuously arranged. Specifically, as shown in FIG. 14(b), 
different labels 1-3 are attached to different continuous 
portions to separate them. 

[0073] 

Further, in the figure combining processing, it is 
necessary to eliminate a small area figure, such as a hole, or 
a figure in the form of a dot contained in the image, since 
these figures are not necessary, and further they may serve as 
noise and adversely affect processing executed later. Noise is 
eliminated by increasing or reducing the size of the original 



- 25 



figure . 

[0074] 

The line thinning processing will be described. 
[0075] 

This is a process of thinning the binary image to a line 
figure of a line width 1 without degrading the continuity of 
the continuous portions contained in the image. Specifically, 
the centerline of a line figure with a certain line width is 
obtained by sequentially removing pixels in the width direction 
of the figure. 

[0075] 

The dimension of a shape determining continuous area is 
determined from the number of pixels belonging to a continuous 
area, while the circumferential length of the area is 
determined from the number of pixels located at the boundary of 
the continuous area. However, the oblique length is obtained 
by multiplying the horizontal or vertical length by . To 
determine the shape of an image, coefficient e as given by the 
following equation is used. 

[0077] 

e = (circumferential length) '^2/(area) 

The coefficient e has a minimum value when the shape is 
circular, and a higher value when the shape is more complicated. 
Since the face of a person is considered substantially circular, 
it is determined whether or not the image is the face of a 
person, by comparing the coefficient e with a predetermined 
value. It is also determined whether or not the continuous 
area is the face of a person, by comparing the dimension of the 
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continuous area with a predetermined value. 
[0078] 

Further, the shape determining processing may not be 
executed if the dimension of the continuous area does not fall 
within a predetermined range, which indicates that the area is 
not a person. In this case, the amount of operation and hence 
the AF time lag can be reduced. 

[0079] 

Referring to the flowchart of FIG. 13, the shape 
determining processing will be described. 

It is determined whether or not any extracted area exists, 
and if there is no extracted area (i.e. if the answer is NO), 
the program returns to the start (step S51) . If, however, 
there is an extracted area (i.e. if the answer at the step S51 
is YES), the dimension S of the extracted area is calculated, 
thereby determining whether or not the area S falls within a 
predetermined range (step S52) . 

[0080] 

If the extracted area dimension S does not fall within 
the predetermined range (i.e. if the answer at the step S52 is 
NO), it is determined that the subject is other than a person 
(step S53), the program returns to the start. If, on the other 
hand, the extracted area dimension S falls within the 
predetermined range (i.e. if the answer at the step S52 is YES), 
a shape determination value e is calculated, thereby 
determining whether or not the value e falls within a 
predetermined range (step S54). If the shape determination 
value e falls within the predetermined range (i.e. if the 



answer at the step S54 is YES), it is determined that the 
subject is a person (step S55) . If the value e does not fall 
within the predetermined range (i.e. if the answer at the step 
S54 is NO), the program returns to the step S53, where it is 
determined that the subject is other than a person. 
[0081] 

After that, it is determined whether or not shape 
determination has been executed on all extracted areas (step 
S56), and if it is determined that the shape determination has 
been executed on all extracted areas (i.e. the answer at the 
step S56 is YES), the program returns to the start. If the 
shape determination has not yet been executed on all extracted 
areas (i.e. the answer at the step S56 is NO), another 
extracted area is set (step S57), and the program returns to 
the step S52, thereby repeating the above processing. 

[0082] 

FIG. 14(a) illustrates a photography screen for pick 
upping a person. FIG. 14(b) illustrates outline data obtained 
after binarization processing, FIG. 14(c) low resolution data, 
and FIG. 14(d) low resolution outline data. 

[0083] 

This photography screen corresponds to the image area of 
the AF area sensor 2 and includes a person as a subject. The 
outline data output from the AF area sensor 2 is binarized, 
thereby extracting only an edge portion (outline) 53 of the 
image as shown in FIG. 14(b). The image having the extracted 
edge portion 53 is divided into sections labeled 1, 2 and 3 by 
the labeling process. 
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The area labeled 3, which is determined to be the face of 
a person, is extracted, and a distance-measuring area 51 
including the person judgment area labeled 3 is set. Then, 
distance calculation is executed on the basis of outline data 
(obtained before binarization processing) in the distance- 
measuring area 51. 

[0084] 

Since the outline data is obtained by a circuit 
incorporated in the AF area sensor, it can be obtained much 
faster than in the case of other operation processing such as 
difference processing. Thus, a distance-measuring device with 
a small time lag is realized. 

[0085] 

Referring then to the flowchart of FIG. 15, a distance- 
measuring device according to a second embodiment of the 
invention will be described. 

Since this embodiment has substantially the same 
structure as the first embodiment, a detailed description will 
be given not of the structure, but of a different distance 
measurement routine . 

[0086] 

First, an operation section incorporated in the camera is 
operated to set a y-projection detection mode for the AF area 
sensor 2 (step S61) . Subsequently, the control section 1 
outputs an integration control signal to the AF area sensor 2, 
thereby making the sensor 2 execute integration processing 
(step S62) . 

The AF area sensor 2 outputs a monitor signal 



corresponding to a peak output (the output of a brightest 
pixel) in a predetermined area. Referring to the monitor 
signal, the period of integration is controlled so that the 
amount of light received by the light receiving section 2a of 
the AF area sensor 2 will be an appropriate value. 
[0087] 

After that, as shown in FIG. 16, sensor data (y- 
projection data) obtained by predetermined integration is read 
from the AF area sensor 2 in accordance with a reading clock 
signal output from the control section 1, then subjected to A/D 
conversion executed by the AD converter Id, and stored in the 
RAM Ic (step S63) . 

[0088] 

Similarly, an x-projection detection mode is set for the 
AF area sensor 2 (step S64), and the control section 1 outputs 
an integration control signal to the AF area sensor 2, thereby 
making the sensor 2 execute integration processing (step S65) . 
After that, as shown in FIG. 16, sensor data (x-projection 
data) obtained by predetermined integration is read from the AF 
area sensor 2 in accordance with a reading clock signal output 
from the control section 1, then subjected to A/D conversion 
executed by the AD converter Id, and stored in the RAM Ic (step 
S66) . 

[0089] 

Subsequently, a main subject is extracted (step S67). A 
normal mode is set for the AF area sensor 2 (step S68). On the 
basis of a monitor signal indicating the position of the 
detected subject, integration control is executed (step S69) . 
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Then, usual sensor data (normal mode data) is read from the AF 
area sensor 2 (step S70) • At this time, it is not necessary to 
read data from all pixels. It is sufficient if data is read 
only from pixels corresponding to the subject and its 
vicinities . 
[0090] 

Thereafter, a distance-measuring area including the 
extracted subject is set, thereby executing distance 
calculation in the distance-measuring area (step S71) and 
driving the focusing lens on the basis of the calculation 
result (step S72) . 

[0091] 

FIG. 16 shows the relationship between the photography 
screen and the projection output obtained by the AF routine 
shown in FIG. 15. A description will be given of main subject 
detection using the projection output. 

As aforementioned, the x-projection output is obtained by 
summing normal pixel outputs (normal sensor data) in the x- 
direction, while the y-projection output is obtained by summing 
normal pixel outputs in the y-direction. In the photography 
screen, the X-direction and the Y-direction correspond to the 
length-direction and the width-direction, respectively. 

[0092] 

Where a background 52 is dark and a main subject 56 is 
bright as shown in FIG. 16, the projection output of the area 
in which the main subject 56 exists is higher than the other 
area . 

In the aforementioned step S67, an area, which includes a 
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region in which the X- and Y-directional output values exceed 
predetermined values Sx and Sy, respectively, is set as a 
distance-measuring area 54 . 
[0093] 

At the step S69, the control section 1 supplies the AF 
area sensor 2 with an instruction to set a monitor pixel area 
corresponding to the distance-measuring area 54. 

Execution of an integration operation based on the 
monitor signal in the monitor area enables acquisition of 
optimum normal sensor data and execution of accurate distance 
calculation in the distance-measuring area 54 as the person 
judgment area. Further, in the case of a backlight scene, an 
area smaller than the main subject area is set as an 
integration control area 55, thereby executing integration 
control. This prevents sensor data in the person judgment area 
from being degraded by the influence of a very bright 
background. 

[0094] 

Referring to the flowchart of FIG. 17, a distance- 
measuring device according to a third embodiment of the 
invention will be described. 

This embodiment has substantially the same structure as 
the first embodiment, and is characterized by a modification of 
the AF routine shown in FIG. 8. In the AF routine employed in 
this embodiment, outline detection of the background of an 
image other than a subject is prohibited. 

[0095] 

First, an operation section incorporated in the camera is 
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operated to set an outline detection mode for the AF area 
sensor 2 (step S81) . 

Subsequently, the control section 1 outputs an 
integration control signal to the AF area sensor 2, thereby 
executing pre-emission/f ixed-light-eliminating- integration 
processing (step S82) . This processing is done because if the 
AF routine shown in FIG. 8 is executed for a to-be-photographed 
scene as shown in FIG. 18(a), it is possible that outline 
detection will be also executed on a background portion other 
than the main subject 56, which inevitably increases the time 
lag. 

To avoid the above, the AF area sensor 2 is made to 
execute the f ixed-light-eliminating-integration processing 
while making the strobe unit 9 execute pre-emission several 
times. Since a larger amount of light is reflected from a 
subject when the subject is closer to the camera, an output 
corresponding to a subject located remoter from the camera can 
be removed if integration control is executed on a peak amount 
of reflected light while executing pre-emission. As a result, 
outline data as shown in FIG. 18(b) can be obtained. 

[0096] 

After that, integrated sensor data (outline data) is read 
from the AF area sensor 2 in accordance with a reading clock 
signal output from the control section 1, then subjected to A/D 
conversion executed by the AD converter Id, and stored in the 
RAM Ic. 

[0097] 

Then, the central processing unit la executes processing 
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for extracting a main subject (step S83) . It is determined 
whether or not the extracted object is the main subject (step 
S84), thereby setting a distance-measuring area including the 
main subject and executing distance calculation (step S85) . In 
this distance calculation, the influence of the background can 
be removed, and hence more accurate main subject detection and 
distance measurement with a small time lag can be realized. 
[0098] 

Further, on the basis of distance measurement data 
obtained by the distance calculation, the focus lens driving 
section 3 drives the focus lens 4 (step S86) . 

[0099] 

In this embodiment, even in a to-be-photographed scene as 
shown in FIG. 18(a) in which an object 57 that may erroneously 
be treated as a subject exists near a main subject 56, only the 
main subject can be subjected to outline detection processing, 
thereby preventing unnecessary processing from being executed 
to minimize the time lag. FIG. 18B shows outline data obtained 
by executing pre-emission and fixed-light-eliminating 
integration on the to-be-photographed scene shown in FIG. 18(a). 

[0100] 

Referring to the flowchart of FIG. 19, a distance- 
measuring device according to a fourth embodiment of the 
invention will be described. This embodiment has substantially 
the same structure as the second embodiment, and is 
characterized by a modification of the AF routine shown in 
FIG. 15. In the AF routine employed in this embodiment, 
projection detection of the background of an image, which has a 
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high brightness, is prohibited. 
[0101] 

First, an operation section incorporated in the camera is 
operated to set a y-projection detection mode for the AF area 
sensor 2 (step S91) . Subsequently, the control section 1 
outputs an integration control signal to the AF area sensor 2, 
thereby making the sensor 2 execute pre-emission/f ixed-light- 
eliminating processing (step S92) . 

[0102] 

If the AF routine shown in FIG. 15 is applied to a to-be- 
photographed scene as shown in FIG. 20, it is possible that 
projection detection will be also executed on the background, 
other than the main subject 56, which has a high brightness, 
thereby preventing detection of the main subject and increasing 
the time lag due to the extra projection detection. 

[0103] 

To avoid the above, the aforementioned pre- 
emission/f ixed-light-eliminating processing is executed. 
[0104] 

More specifically, the AF area sensor 2 is made to 
execute the f ixed-light-eliminating-integration processing 
while making the strobe unit 9 execute pre-emission several 
times. Since a larger amount of light is reflected from a 
subject when the subject is closer to the camera, an output 
corresponding to a subject located remoter from the camera can 
be removed if integration control is executed on a peak amount 
of reflected light while executing pre-emission. As a result, 
Sy projection data (Sx projection data) as shown in FIG. 20 can 
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be obtained, thereby removing the influence of the background 
and realizing more accurate distance measurement with a small 
time lag. 

[0105] 

After that, sensor data (y-pro jection data) obtained by 
predetermined integration is read from the AF area sensor 2 in 
accordance with a reading clock signal output from the control 
section 1, then subjected to A/D conversion executed by the AD 
converter Id, and stored in the RAM Ic (step S93) . 

[0106] 

Subsequently, main subject detection is executed (step 
S94), and it is determined whether or not a main subject has 
been detected (step S95) . If it is determined that the main 
subject has been detected (i.e. the answer at the step S95 is 
YES), processing in the x-projection mode is omitted, and the 
normal mode is set for the AF area sensor 2 (step S96) . This 
is because it is possible that the main subject will be 
detected only from y-projection data, since the background 
scene can be removed only on the basis of the y-projection data. 
If the main subject is detected only from the y-projection data, 
the next processing to be executed in the x-projection mode can 
be omitted, thereby reducing a time lag such as an integration 
period. 

[0107] 

In this case, integration control based on a monitor 
signal corresponding to the position of the detected main 
subject is executed in the normal mode (step S97). 
Subsequently, normal sensor data (data obtained in the normal 
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mode) is read from the AF area sensor 2 (step S98) . At this 
time, it is not necessary to read data from all pixels. It is 
sufficient if data is read only from pixels corresponding to 
the subject and its vicinities. 
[0108] 

Thereafter, a distance-measuring area 54 including the 
extracted subject is set, thereby executing distance 
calculation in the distance-measuring area (step S99) and 
driving the focusing lens on the basis of the calculation 
result (step SlOO) . 

[0109] 

If, on the other hand, any main subject is not detected 
at the step S95 (i.e. if the answer at the step S95 is NO), the 
x-projection mode is set for the AF area sensor 2 by a similar 
operation (step SlOl) . Then, pre-emission/f ixed-light- 
eliminating processing is executed (step S102) . 

[0110] 

Sensor data (x-projection data) obtained by predetermined 
integration is read from the AF area sensor 2 in accordance 
with a reading clock signal output from the control section 1, 
then subjected to A/D conversion executed by the AD converter 
Id, and stored in the RAM Ic (step S103) . 

[0111] 

Thereafter, main subject detection is executed (step 
S104), and it is determined whether or not a main subject has 
been detected (step S105) . If it is determined that the main 
subject has been detected (i.e. the answer at the step S105 is 
YES), which indicates that the main subject can be detected on 
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the basis of both the y-projection data and the x-projection 
data, the program returns to the step S96. However, if any 
main subject is not detected (i.e. if the answer at the step 
S105 is NO) , the AF area sensor 2 is set in the normal mode 
(step S106) . 
[0112] 

Subsequently, integration control is executed for each 
block (step S107) . In this control, the pixel area of the AF 
area sensor 2 corresponding to the photography screen (or the 
light receiving area of the AF sensor corresponding to the 
photography screen) is divided into a plurality of blocks (El, 
E2, •••)/ thereby executing integration control with reference 
to a monitor signal for each block. 

[0113] 

After that, sensor data is read from the AF area sensor 2 
under the control of the control section 1 (step S108), and 
distance calculation is sequentially executed for each block 
(step S109) , thereby determining appropriate distance 
measurement data from distance measurement data obtained from 
all blocks (step SllO) . The appropriate distance measurement 
data is data indicating a shortest distance. Thus, when the 
main subject cannot be detected from both the x- and y- 
projection data, distance measurement is executed on the entire 
screen, thereby creating distance measurement data based on a 
predetermined algorithm (shortest distance selection, average 
value calculation, etc.). 
[0114] 

Then, the program returns to the step SlOO, where the 
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focusing lens is driven on the basis of the determined distance 
measurement data. 
[0115] 

In this embodiment, even in a to-be-photographed scene as 
shown in FIG. 20 in which an object that may erroneously be 
treated as a subject exists other than a main subject, only the 
main subject can be subjected to projection detection 
processing, thereby preventing unnecessary processing from 
being executed to minimize the time lag. 

[0116] 

Referring to the flowchart of FIG. 22, a distance- 
measuring device according to a fifth embodiment of the 
invention will be described. 

[0117] 

First, an operation section incorporated in the camera is 
operated to set a low resolution mode for the AF area sensor 2 
(step Sill) . Then, integration control is executed by the 
control section 1 (step S112) . 

[0118] 

After that, sensor data (low resolution data) obtained by 
predetermined integration is read from the AF area sensor 2 in 
accordance with a reading clock signal output from the control 
section 1, then subjected to A/D conversion executed by the AD 
converter Id, and stored in the RAM Ic (step S113) . The stored 
sensor data is low resolution data as shown in FIG. 14(c) 
obtained from a to-be-photographed scene as shown in FIG. 14(a). 

[0119] 

Subsequently, main subject detection is executed on the 
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basis of the low resolution data (step S114) . 
[0120] 

Then, a high resolution mode (normal mode) is set for the 
AF area sensor 2 (step S115) . Integration control is executed 
on the basis of a monitor signal indicating the position of the 
detected main subject (step S116) . Sensor data (high 
resolution data) is read from the AF area sensor 2 (step S117) . 

[0121] 

After that, a distance-measuring area including the 
detected main subject is set, thereby executing distance 
calculation in the distance-measuring area (step S118). On the 
basis of the calculation result, the focusing lens is driven 
(step S119) . 
[0122] 

Referring now to the flowchart of FIG. 23, main subject 
detection executed at the step S114 will be described. 
[0123] 

The main subject detection is executed by substantially 
the same routine as shown in FIG. 9, except for that low 
resolution sensor data is subjected to difference processing. 

[0124] 

The sensor data output from the AF area sensor 2 for main 
subject detection is stored in the RAM Ic of the control 
section 1, and the following processing is executed on the 
basis of this sensor data. 

[0125] 

The read sensor data is subjected to smoothing processing 
(step S121) . This smoothing processing is a process for 
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eliminating random noise contained in an image by filtering 
processing or Fourier transform. 
[0126] 

The obtained low resolution data is subjected to 
difference processing (step S123) . This difference processing 
is a process for executing edge detection, thereby providing 
edge candidate areas and their intensities. 

[0127] 

In this edge detection, sensor data s(i,j) as shown in 
FIG. 24 is subjected to the following processing: 
[0128] 

In the case of a method using a first-degree differential 
operator, x- and y-directional differential values are given by 
the following equations: 

[0129] 

Axs(i,j) = s(i,j) - s(i-l,j) 
Ays(i,j) = s(i,j) - s(i,j-l) 

As a result, data as shown in FIG. 25(a) is obtained. 
[0130] 

Further, in the case of a method using a second-degree 
differential operator, x- and y-directional differential values 
are given by the following equations: 

[0131] 

A"2xs(i,j) = s(i-l,j) - 2s(i,j) - s(i+l,j) 
A"2ys(i,j) - s(i-l,j) - 2s(i,j) - s(i,j+l) 
The Laplacian operator as a kind of second-degree 
differential operator emphasizes an edge, and hence data at the 
portion is shifted from a positive value to a negative value. 
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In light of this, an edge can be obtained by extracting a 
portion "0". 
[0132] 

More specifically, sum of products using a space filter 
table (weight table) is calculated. FIGS. 26(a) - 26(d) show 
examples of space filter tables. 

[0133] 

FIGS. 26(a) and 26(b) show first-degree differential 
operators (in the row and column directions), FIG. 26(c) the 
Laplacian operator, and FIG. 26(d) the Sobel operator (for 
executing x- and y-directional first-degree differential, 
absolute value transformation, addition) . 

[0134] 

The following calculation formula is used: 
[0135] 

1 ^'^ 

s' (X, y) = - S s(x + i, y + j) . w(i, j) (1) 
[0136] i = = 

where S(x,y) represents data before processing, S'(x,y) data 
after processing, W(x,y) a space filter, and n a constant. 
[0137] 

The aforementioned space filters are selectively used in 
accordance with the circumstances. When difference processing 
is executed on an image that occupies the entire photography 
screen, the first-degree differential operator or the Laplacian 
operator is used since calculation using the operator is 
relatively easy and executed at high speed. 

[0138] 

On the other hand, when difference processing is executed 
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on an image that occupies only part of the photography screen, 
the Sobel operation is used, since calculation using this 
operator is very effective in this case although it is 
relatively complicated and hence requires a long calculation 
period. 

[0139] 

Furthermore, in order to reduce the AF time lag, the 
operators may be switched such that the first-degree 
differential operator or the Laplacian operator is used when 
processing an image that has a low brightness and requires a 
long integration period of the AF area sensor 2, while the 
Sobel operator is used when processing an image that has a high 
brightness and requires only a short integration period. 

[0140] 

As described above, in the case of low resolution data, 
outline detection is executed using difference processing, 
[0141] 

Thereafter, the image obtained after difference 
processing is subjected to processing based on a predetermined 
threshold level, as at the step S22 of FIG. 9, thereby 
extracting a portion of the image which has a level lower than 
the predetermined threshold level, to obtain a binary image 
(step S123) . 

[0142] 

After that, the central processing unit la executes 
labeling and figure combining processing on the binary image 
(step S124), thereby obtaining a figure having a certain width 
corresponding to an edge obtained by line thinning processing 
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(step S125) . The line width of this figure is reduced to about 
1, using line thinning algorithm. 
[0143] 

Subsequently, the shape of the image is determined by 
shape determination processing, described later, thereby 
extracting the main subject (step S126) . 

[0144] 

Since low resolution data can be obtained at high speed 
by using the low resolution mode, higher processing can be 
realized than in the case of using calculation processing such 
as addition . 

[0145] 

Further, since the main subject detection is executed by 
reducing the number of data items, i.e. using low resolution 
data, higher main subject detection processing is realized. In 
addition, distance calculation is executed on the basis of high 
resolution data, thereby enabling accurate distance measurement. 

[0146] 

Referring to the flowchart of FIG. 27, a distance- 
measuring device according to a sixth embodiment of the 
invention will be described. 

[0147] 

In this embodiment, usual integration executed in the 
case shown in FIG. 22 is replaced with pre-emission /fixed- 
light-eliminating integration. Since in this case, even in the 
low resolution mode, an integration operation is executed while 
fixed light is eliminated using pre-emission of the strobe unit 
9, the influence of the background at a long distance can be 
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eliminated, thereby enabling accurate main subject detection. 
[0148] 

First, an operation section incorporated in the camera is 
operated to set a low resolution mode for the AF area sensor 2 
(step S131) . Then, pre-emission/ fixed-light-eliminating 
integration control is executed, in which the AF area sensor 
executes an integration operation under the control of the 
control section 1, while the strobe unit 9 executes pre- 
emission to eliminate fixed light under the control of the 
control section 1 (step S132) . 

[0149] 

After that, sensor data (low resolution data) obtained by 
predetermined integration is read from the AF area sensor 2 in 
accordance with a reading clock signal output from the control 
section 1, then subjected to A/D conversion executed by the AD 
converter Id, and stored in the RAM Ic (step S133) . 

[0150] 

Subsequently, main subject detection is executed on the 
basis of the low resolution data (step S134) . When executing 
distance measurement, a high resolution mode is set for the AF 
area sensor 2 (step S135) . Then, it is determined whether or 
not the detected main subject has a low contrast (step S136) . 
If it is determined that the detected main subject does not 
have a low contrast (i.e. the answer at the step S136 is YES), 
a fixed-light-eliminating integration operation is executed on 
the basis of the position of the main subject, while 
controlling the strobe unit 9 so as to execute pre-emission 
(step S137) . 



[0151] 

After that, usual integration control is executed on the 
basis of a monitor signal indicating the position of the 
detected main subject (step S138) , thereby reading sensor data 
(high resolution data) from the AF area sensor 2 (step S139) . 
If, on the other hand, it is determined at the step S136 that 
the main subject has a low contrast (i.e. if the answer at the 
step S136 is NO) , the program directly proceeds to the step 
S139. 

[0152] 

Thereafter, a distance-measuring area including the 
detected main subject is set, thereby executing distance 
calculation in the distance-measuring area (step S140) . On the 
basis of the calculation result, the focusing lens is driven 
(step S141) . 
[0153] 

Since in this embodiment, the condition of the main 
subject is determined by main subject detection processing, and 
the integration mode is changed (between usual integration and 
pre-emission/f ixed-light-eliminating integration) , an 
integration operation suitable for a main subject can be 
executed, and hence the accuracy of detection is enhanced. 

[0154] 

Referring to the flowchart of FIG. 28, a distance- 
measuring device according to a seventh embodiment of the 
invention will be described. 

[0155] 

In this embodiment, the AF area sensor 2 is set in a low- 
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resolution/outline mode, and main subject detection is executed 
on the basis of obtained low-resolution/outline data. 
[0156] 

First, an operation section incorporated in the camera is 
operated to set a low-resolution/outline detection mode for the 
AF area sensor 2 (step S151) . Subsequently, the control 
section 1 outputs an integration control signal to the AF area 
sensor 2, thereby making the sensor 2 execute integration 
processing (step S152) . 

[0157] 

After that, sensor data (low-resolution/outline data) 
obtained by predetermined integration is read from the AF area 
sensor 2 in accordance with a reading clock signal output from 
the control section 1, then subjected to A/D conversion 
executed by the AD converter Id, and stored in the RAM Ic (step 
S153) . The stored sensor data is low resolution data as shown 
in FIG. 14(c) obtained from a to-be-photographed scene as shown 
in FIG. 14 (a) . 

[0158] 

Subsequently, main subject detection is executed on the 
basis of the low-resolution/outline data (step S154). During 
distance measurement, a high-resolution/outline mode is set for 
the AF area sensor 2 (step S155) . 

[0159] 

Integration control is executed on the basis of the 
position of the detected main subject (step S156) . Sensor data 
(high resolution data) is read from the AF area sensor 2 (step 
S157) . 
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Thereafter, a distance-measuring area including the 
detected main subject is set, thereby executing distance 
calculation in the distance-measuring area (step S158) . On the 
basis of the calculation result, the focusing lens is driven 
(step S159) . 
[0160] 

Since low resolution data can be obtained at high speed 
by using the low resolution mode, higher processing can be 
realized than in the case of low resolution data acquisition 
using calculation processing such as addition. Further, since 
the main subject detection is executed by reducing the number 
of data items, i.e. using low resolution data, higher main 
subject detection processing is realized. 

[0161] 

In addition, since outline data can be obtained at high 
speed by using the outline mode, higher processing can be 
realized than in the case of outline data acquisition using 
calculation processing such as addition. Further, since the 
main subject detection is executed on the basis of the acquired 
outline data, higher main subject detection processing is 
realized. Distance calculation is executed on the basis of 
high resolution data, thereby enabling accurate distance 
measurement . 

[0162] 

The above-provided descriptions are directed to some of 
possible embodiments of the present invention; however this 
specification includes the following invention. 
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[0163] 

(l) A distance-measuring device comprising: 

an AF area sensor formed on a semiconductor substrate for 
pick upping two images formed to have a parallax therebetween, 
and integrating sensor data that corresponds to an appropriate 
amount of light; 

a photo reception signal processing circuit formed on the 
semiconductor substrate for creating outline data based on the 
sensor data from the AF area sensor; 

a control section detecting a main subject in a 
photography screen on the basis of the outline data output from 
the photo reception signal processing circuit, and setting, in 
the photography screen, a distance-measuring area including the 
main subject; and 

a distance-measuring section for executing distance 
measurement in the distance-measuring area set by the control 
section . 

[0164] 

(2) The distance-measuring device according to claim 1, 
wherein the AF area sensor includes: 

a pixel area in which photoelectric elements are arranged 
in a matrix, the photoelectric elements each receiving image 
for distance measurement formed by two photoelectric lenses 
located before the AF area sensor and having a parallax 
therebetween; 

a horizontal/vertical control circuit operable under the 
control of the control section for scanning and outputting an 
amount of the image for distance measurement accumulated by the 
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photoelectric elements included in the pixel area; 

an output circuit for amplifying, by a predetermined 
level, a signal output from the horizontal/vertical control 
circuit; and 

a sensor control circuit operable under the control of 
the control section for controlling received-image accumulation 
and output operation of the AF area sensor, 

the pixel area, the horizontal/vertical control circuit, 
the output circuit and the sensor control circuit being formed 
on a silicon substrate by a CMOS process. 

[0165] 

(3) The distance-measuring device according to claim 13, 
wherein the horizontal/vertical control circuit of the AF area 
sensor sequentially applies a sensitivity control signal to the 
photoelectric elements in units of one row of the matrix, 
thereby extracting an amount of image for distance measurement 
accumulated by those of photoelectric elements, which are 
located in each column of the matrix, extracting only a column 
at which the amount of image for distance measurement changes, 
detecting, simultaneously and in a parallel manner, pieces of 
outline data each corresponding to one scanning line, and 
outputting the detection result as the outline data. 

[0166] 

[Advantage of the Invention] 

As described above in detail, the present invention 
provides a compact and cost-effective distance-measuring device 
having a wide distance-measuring area and capable of detecting 
a main subject with a small time lag, the distance-measuring 
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device comprising an AF area sensor, which includes an image 
pick up element formed on a semiconductor substrate for 
receiving input image signals having a parallax therebetween, 
and a photo reception signal processing circuit formed on the 
semiconductor substrate for creating data by processing an 
image of a subject based on the output of the image pick up 
element . 

[Brief Description of the Drawings] 
[FIG. 1] 

FIG. 1 is a block diagram illustrating a camera incorporating 
a distance-measuring device according to a first embodiment of 
the invention . 
[FIG. 2] 

FIG. 2 is a flowchart useful in explaining a main routine for 
executing photography. 
[FIG. 3] 

FIGS. 3A and 3B are views useful in explaining a passive-type 
distance measurement optical system using outside light. 
[FIG. 4] 

FIG. 4 is a view specifically illustrating the structure of an 
AF sensor. 

[FIG. 5] 

FIG. 5 is a view specifically illustrating a differential 
amplification circuit SA. 
[FIG. 6] 

FIGS. 6A, 6B and 6C are views illustrating the conceptual 
relationship between the AF sensor and an input image. 
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[FIG. 7] 

FIG. 7 is a view illustrating the relationship between a 
distance-measuring area and the wide-end and telescopic-end 
sizes of a photography screen; 
[FIG. 8] 

FIG. 8 is a flowchart useful in explaining an AF routine 
executed in the distance-measuring device of the first 
embodiment . 

[FIG. 9] 

FIG. 9 is a flowchart useful in explaining a routine for 
detecting a main subject. 
[FIG. 10] 

FIG. 10 is a flowchart useful in explaining binarization 
processing (processing based on a threshold level) . 
[FIG. 11] 

FIGS. IIA and IIB are views each illustrating the 
relationship between the brightness and the frequency for 
setting a threshold level . 
[FIG. 12] 

FIG. 12 is a flowchart useful in explaining threshold level 
setting processing. 
[FIG. 13] 

FIG. 13 is a flowchart useful in explaining shape 
determination processing . 
[FIG. 14] 

FIGS. 14A, 14B, 14C and 14D are views illustrating examples 
of to-be-photographed scenes for determining a person, outline 
data obtained after the scenes are subjected to binarization 
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processing, low resolution data and low resolution outline data. 
[FIG. 15] 

FIG. 15 is a flowchart useful in explaining a distance- 
measuring device according to a second embodiment of the 
invention . 

[FIG. 16] 

FIG. 16 is a view illustrating the relationship between a 
photography screen and a projection output in an AF routine in 
the second embodiment. 
[FIG. 17] 

FIG. 17 is a flowchart useful in explaining a distance- 
measuring device according to a third embodiment of the 
invention. 

[FIG. 18] 

FIGS- 18A and 18B are views showing a to-be-photographed 
scene including a person, and outline data on the person. 
[FIG. 19] 

FIG. 19 is a flowchart useful in explaining a distance- 
measuring device according to a fourth embodiment of the 
invention. 

[FIG. 20] 

FIG. 20 is a view showing examples of x- and y-directional 
projections of a to-be-photographed scene. 
[FIG. 21] 

FIG. 21 is a view showing an example of a pixel area 
incorporated in an AF area sensor and corresponding to a to-be- 
photographed screen, the pixel area being divided into a 
plurality of blocks. 
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[FIG. 22] 

FIG. 22 is a flowchart useful in explaining a distance- 
measuring device according to a fifth embodiment of the 
invention. 

[FIG. 23] 

FIG. 23 is a flowchart useful in explaining the manner of 
detecting a main subject in the fifth embodiment of the 
invention. 

[FIG. 24] 

FIG. 24 is a view useful in explaining edge detection 
processing. 

[FIG. 25] 

FIGS. 25A and 25B are views illustrating the distinctives of 
an original image photographed by the primary differential 
operator method for edge detection, and the distinctives of an 
image obtained after processing the original image. 
[FIG. 26] 

FIGS. 26A, 26B, 260 and 26D are views showing examples of 
spatial filter tables. 
[FIG. 27] 

FIG. 27 is a flowchart useful in explaining the manner of 
detecting a main subject in a sixth embodiment of the invention. 
[FIG. 28] 

FIG. 28 is a flowchart useful in explaining the manner of 
detecting a main subject in a seventh embodiment of the 
invention. 
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[ DOCUMENT ] ABSTRACT 
[Abstract] 

[Object] If distance measurement by a conventional artificial 
retina LSI that has a parallax is used in a camera, a CPU, 
which operates at high speed to execute complicated processing, 
and/or a correlation calculation unit must be mounted in the 
camera. These units are expensive, and the number of component 
parts of the distance-measuring device and hence the size of 
the distance-measuring device inevitably increased because of 
these units . 

[Means for Achieving the Objects] The present invention 
provides a distance-measuring device has an AF area sensor that 
includes an image pick up element formed on a semiconductor 
substrate for receiving two images having a parallax 
therebetween, and a photo reception signal processing circuit 
formed on the semiconductor substrate for processing signals 
corresponding to light received by the image pick up element. 
On the basis of sensor data (outline data) obtained by 
integration executed in the AF area sensor in an outline 
detection mode, the distance-measuring device detects a main 
subject in a photography screen, sets a distance-measuring area 
including the main subject, and measures a distance to the main 
subject . 

[Elected Figure] FIG. 1 



APPLICANT'S PAST DATA 



Identification Number 

1. Date of Change 

[Reason for Change] 
[Address] 

[Name] 



[000000376] 

August 20, 1990 

New Registration 

43-2, Hatagaya 2-chome, 
Shibuya-]cu, ToJcyo 

OLYMPUS OPTICAL CO., LTD. 



